Sep 25 13:29:37 devstack cinder-volume[76124]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 13:29:37 devstack cinder-volume[76124]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 13:29:37 devstack cinder-volume[76124]: we strongly recommend against using it for new projects. Sep 25 13:29:37 devstack cinder-volume[76124]: If you are already using Eventlet, we recommend migrating to a different Sep 25 13:29:37 devstack cinder-volume[76124]: framework. For more detail see Sep 25 13:29:37 devstack cinder-volume[76124]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 13:29:37 devstack cinder-volume[76124]: import eventlet # noqa Sep 25 13:29:40 devstack cinder-volume[76124]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:29:40 devstack cinder-volume[76124]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:29:40 devstack cinder-volume[76124]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:29:41 devstack cinder-volume[76124]: INFO dbcounter [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Registered counter for database cinder Sep 25 13:29:41 devstack cinder-volume[76124]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:29:41 devstack cinder-volume[76124]: DEBUG dbcounter [-] [76124] Writer thread running {{(pid=76124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 13:29:41 devstack cinder-volume[76124]: INFO cinder.rpc [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 13:29:41 devstack cinder-volume[76124]: INFO cinder.rpc [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:29:42 devstack cinder-volume[76124]: INFO cinder.volume.manager [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Determined volume DB was empty at startup. Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG cinder.volume.manager [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76124) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 13:29:42 devstack cinder-volume[76124]: INFO cinder.volume.manager [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 13:29:42 devstack cinder-volume[76124]: WARNING stevedore.named [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 13:29:42 devstack cinder-volume[76124]: WARNING castellan.key_manager [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:29:42 devstack cinder-volume[76124]: WARNING cinder.keymgr.conf_key_mgr [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG cinder.volume.drivers.lvm [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76124) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_concurrency.processutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_concurrency.processutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] CMD "cinder-rtstool verify" returned: 0 in 0.467s {{(pid=76124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:29:42 devstack cinder-volume[76124]: INFO cinder.rpc [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 13:29:42 devstack cinder-volume[76124]: INFO cinder.rpc [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 13:29:42 devstack cinder-volume[76124]: WARNING stevedore.named [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 13:29:42 devstack cinder-volume[76124]: WARNING castellan.key_manager [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:29:42 devstack cinder-volume[76124]: INFO cinder.volume.manager [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:29:42 devstack cinder-volume[76124]: INFO oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Starting 1 workers Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Started child 76339 {{(pid=76124) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Full set of CONF: {{(pid=76124) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] ******************************************************************************** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Configuration options gathered from: {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] ================================================================================ {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] allow_availability_zone_fallback = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] allow_compression_on_image_upload = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76339]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] allowed_direct_url_schemes = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] api_rate_limit = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] auth_strategy = keystone {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] az_cache_duration = 3600 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_availability_zone = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_host = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_stats_polling_interval = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backup_api_class = cinder.backup.api.API {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backup_name_template = backup-%s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backup_use_same_host = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backup_use_temp_snapshot = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] chap_password = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] chap_username = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_internal_tenant_project_id = 0d3d6c192e0a43b8bbb7c367817701d1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_internal_tenant_user_id = ae5054a8dec8457eae02120815ccf7b0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cloned_volume_same_az = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cluster = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] compression_format = gzip {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] compute_api_class = cinder.compute.nova.API {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] config_dir = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] config_source = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] control_exchange = openstack {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] debug = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] default_availability_zone = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] default_group_type = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] default_volume_type = lvmdriver-1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] disk_geometry = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] driver_client_cert = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] driver_client_cert_key = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] driver_data_namespace = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] driver_ssl_cert_path = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] driver_ssl_cert_verify = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] driver_use_ssl = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] enable_force_upload = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] enable_new_services = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] enable_unsupported_driver = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] enabled_backends = ['lvmdriver-1'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] enforce_multipath_for_image_xfer = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] filter_function = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_api_insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_api_ssl_compression = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_ca_certificates_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_catalog_info = image:glance:publicURL {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_num_retries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance_request_timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] goodness_function = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] graceful_shutdown_timeout = 5 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] group_api_class = cinder.group.api.API {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] host = devstack {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_compress_on_upload = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_conversion_address_space_limit = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_conversion_cpu_limit = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_conversion_disable = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_introspection_address_space_limit = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_introspection_cpu_limit = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_upload_use_cinder_backend = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_upload_use_internal_tenant = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_volume_cache_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_volume_cache_max_count = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] image_volume_cache_max_size_gb = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] init_host_max_objects_retrieval = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] instance_format = [instance: %(uuid)s] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] iscsi_target_flags = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] iscsi_write_cache = on {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] iser_helper = tgtadm {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] iser_ip_address = 192.168.122.50 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] iser_port = 3260 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_color = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_config_append = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_dir = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_options = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_rotate_interval = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_rotate_interval_type = days {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] log_rotation_type = none {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] max_age = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] max_logfile_count = 30 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] max_logfile_size_mb = 200 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] max_over_subscription_ratio = 20.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] message_reap_interval = 86400 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] message_ttl = 2592000 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] migration_create_volume_timeout_secs = 300 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] monkey_patch = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] monkey_patch_modules = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] my_ip = 192.168.122.50 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] no_snapshot_gb_quota = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] num_iser_scan_tries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] num_shell_tries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] num_volume_device_scan_tries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] nvmeof_conn_info_version = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] nvmet_ns_id = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] nvmet_port_id = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_max_limit = 1000 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_volume_ext_list = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_volume_listen = 0.0.0.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_volume_listen_port = 8776 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_volume_use_ssl = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] osapi_volume_workers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] per_volume_size_limit = -1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] periodic_fuzzy_delay = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] periodic_interval = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] project_id_regex = [0-9a-f\-]+ {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] public_endpoint = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] publish_errors = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_backup_gigabytes = 1000 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_backups = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_gigabytes = 1000 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_groups = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_snapshots = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] quota_volumes = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] rate_limit_burst = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] rate_limit_except_level = CRITICAL {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] rate_limit_interval = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] reinit_driver_count = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] replication_device = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] report_discard_supported = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] report_interval = 120 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] reservation_clean_interval = 86400 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] reservation_expire = 86400 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] reserved_image_namespaces = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] reserved_percentage = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:42 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] rpc_response_timeout = 120 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] run_external_periodic_tasks = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] scst_target_driver = iscsi {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] scst_target_iqn_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_down_time = 720 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] shell_completion = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] snapshot_name_template = snapshot-%s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] snapshot_same_host = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] split_loggers = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] state_path = /opt/stack/data/cinder {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] storage_availability_zone = nova {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] storage_protocol = iSCSI {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] syslog_log_facility = LOG_USER {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] target_helper = lioadm {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] target_ip_address = 192.168.122.50 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] target_port = 3260 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] target_protocol = iscsi {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] target_secondary_ip_addresses = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] trace_flags = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] transfer_api_class = cinder.transfer.api.API {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] transport_url = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] until_refresh = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_chap_auth = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_default_quota_class = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_journal = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_json = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_multipath_for_image_xfer = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_stderr = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] use_syslog = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] verify_glance_signatures = enabled {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_api_class = cinder.volume.api.API {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_backend_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_clear = zero {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_clear_ionice = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_clear_size = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_copy_bps_limit = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_dd_blocksize = 1M {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_name_template = volume-%s {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_service_inithost_offload = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volume_usage_audit_period = month {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] zoning_mode = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_concurrency.disable_process_locking = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.auth_section = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.auth_type = password {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.auth_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.cache = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.delay_auth_decision = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.http_connect_timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.include_service_catalog = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.interface = public {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_password = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcache_username = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.region_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.service_token_roles_required = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.service_type = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.token_cache_time = 300 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.backend = dogpile.cache.null {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.backend_argument = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.backend_expiration_time = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.config_prefix = cache.oslo {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.debug_cache_backend = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.enable_retry_client = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.enable_socket_keepalive = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.expiration_time = 600 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.hashclient_retry_attempts = 2 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_dead_retry = 300 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_pool_maxsize = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_sasl_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.password = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.proxies = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.redis_db = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.redis_sentinel_service_name = mymaster {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.redis_server = localhost:6379 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.retry_attempts = 2 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.retry_delay = 0.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.socket_keepalive_count = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.socket_keepalive_idle = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.socket_keepalive_interval = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.socket_timeout = 1.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.tls_allowed_ciphers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.tls_cafile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.tls_certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.tls_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.tls_keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cache.username = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] coordination.backend_url = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.asyncio_connection = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.asyncio_slave_connection = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.backend = sqlalchemy {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.connection = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.connection_debug = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.connection_parameters = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.connection_recycle_time = 3600 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.connection_trace = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.db_inc_retry_interval = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.db_max_retries = 20 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.db_max_retry_interval = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.db_retry_interval = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.max_overflow = 50 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.max_pool_size = 5 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.max_retries = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.mysql_wsrep_sync_wait = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.pool_timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.retry_interval = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.slave_connection = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.sqlite_synchronous = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.synchronous_reader = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] database.use_db_reconnect = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_tracing.insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.connection_string = messaging:// {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.es_doc_type = notification {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.es_scroll_size = 10000 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.es_scroll_time = 2m {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.filter_error_trace = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.hmac_keys = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.sentinel_service_name = mymaster {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.socket_timeout = 0.1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.trace_requests = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler.trace_sqlalchemy = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler_jaeger.process_tags = {} {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler_jaeger.service_name_prefix = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] profiler_otlp.service_name_prefix = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.enforce_new_defaults = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.policy_default_rule = default {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.policy_file = policy.yaml {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_policy.remote_timeout = 60.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.group = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.helper_command = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] privsep_osbrick.user = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.group = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.helper_command = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] cinder_sys_admin.user = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.auth_section = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.auth_type = password {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.cafile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.collect_timing = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.send_service_user_token = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.split_loggers = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.tls_ciphers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] service_user.tls_min_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.auth_section = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.auth_type = password {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.collect_timing = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.region_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.split_loggers = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.tls_ciphers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] glance.tls_min_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.backend_availability_zone = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.chap_password = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.chap_username = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.disk_geometry = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.driver_client_cert = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.driver_client_cert_key = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.driver_data_namespace = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.driver_use_ssl = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.enable_unsupported_driver = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.extra_capabilities = {} {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.filter_function = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.goodness_function = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.iscsi_target_flags = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.iscsi_write_cache = on {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.iser_helper = tgtadm {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.iser_port = 3260 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.lvm_mirrors = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.lvm_share_target = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.lvm_type = auto {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.num_shell_tries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.nvmet_port_id = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.replication_device = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.report_discard_supported = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.reserved_percentage = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.scst_target_driver = iscsi {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.scst_target_iqn_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.storage_protocol = iSCSI {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.target_helper = tgtadm {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.target_port = 3260 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.target_protocol = iscsi {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.trace_flags = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.unique_fqdn_network = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.use_chap_auth = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_backend_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_clear = zero {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_clear_ionice = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_clear_size = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volume_group = cinder-volumes {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_reports.file_event_handler = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_reports.log_dir = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.backend_availability_zone = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.backend_host = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.chap_password = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.chap_username = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.chiscsi_conf = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.disk_geometry = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.driver_client_cert = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.driver_data_namespace = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.driver_use_ssl = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.extra_capabilities = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.filter_function = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.goodness_function = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.iser_helper = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.iser_ip_address = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.iser_port = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.iser_target_prefix = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.lvm_conf_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.lvm_mirrors = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.lvm_share_target = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.lvm_type = auto {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.num_shell_tries = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.nvmet_port_id = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.replication_device = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.report_discard_supported = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.reserved_percentage = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.scst_target_driver = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.storage_protocol = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.target_helper = lioadm {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.target_ip_address = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.target_port = 3260 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.target_protocol = iscsi {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.trace_flags = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.use_chap_auth = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_clear = zero {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_clear_size = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] lvmdriver-1.volumes_dir = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.ssl_version = {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_notifications.driver = [] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_notifications.retry = -1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] oslo_messaging_notifications.transport_url = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] key_manager.fixed_key = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.barbican_api_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.barbican_endpoint = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.barbican_endpoint_type = public {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.barbican_region_name = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.cafile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.collect_timing = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.number_of_retries = 60 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.retry_delay = 1 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.send_service_user_token = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.split_loggers = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.tls_ciphers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.tls_min_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.verify_ssl = True {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican.verify_ssl_path = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.auth_section = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.auth_type = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.cafile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.certfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.collect_timing = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.insecure = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.keyfile = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.split_loggers = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.timeout = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.tls_ciphers = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] barbican_service_user.tls_min_version = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.approle_role_id = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.approle_secret_id = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.auth_method = approle {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.auth_path = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.kv_mountpoint = secret {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.kv_path = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.kv_version = 2 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.namespace = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.root_token_id = **** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.ssl_ca_crt_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.timeout = 60.0 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.token_file = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.token_role = None {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.use_ssl = False {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:29:43 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] ******************************************************************************** {{(pid=76124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 13:29:43 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:43 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:43 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:43 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.261s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:29:43 devstack cinder-volume[76339]: INFO cinder.brick.local_dev.lvm [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:43 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:43 devstack sudo[76615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:29:43 devstack sudo[76615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:44 devstack sudo[76615]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:44 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:44 devstack cinder-volume[76339]: DEBUG cinder.brick.local_dev.lvm [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76339) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 13:29:44 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:44 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:44 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:45 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.020s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:45 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:45 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:45 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:45 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 13:29:45 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:45 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.286s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:45 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:45 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:29:45 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:46 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:46 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:29:46 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:46 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:46 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:46 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:46 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:46 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:46 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:46 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:46 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:46 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:46 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:47 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:47 devstack cinder-volume[76339]: INFO cinder.volume.drivers.lvm [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:47 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:47 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:47 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:47 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:29:47 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:47 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:47 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:47 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:47 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:48 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:48 devstack sudo[77122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:48 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:48 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:48 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:48 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:48 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:48 devstack cinder-volume[76339]: INFO cinder.volume.driver [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Driver hasn't implemented _init_vendor_properties() Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG cinder.volume.driver [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76339) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_db.sqlalchemy.engines [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writer thread running {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG cinder.db.api [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Building query based on filter {{(pid=76339) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG cinder.image.image_utils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76339) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 13:29:48 devstack cinder-volume[76339]: INFO cinder.keymgr.migration [None req-98ca644a-6e29-482f-841c-b8b32e64530c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:29:48 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:48 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:29:48 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:49 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:49 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:49 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:49 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:49 devstack sudo[77136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:49 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:49 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:49 devstack sudo[77140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:49 devstack sudo[77140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:49 devstack sudo[77140]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:49 devstack cinder-volume[76339]: DEBUG cinder.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Notifying Schedulers of capabilities ... {{(pid=76339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:29:50 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Driver initialization completed successfully. Sep 25 13:29:50 devstack cinder-volume[76339]: INFO cinder.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Initiating service 2 cleanup Sep 25 13:29:50 devstack cinder-volume[76339]: INFO cinder.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Service 2 cleanup completed. Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG cinder.service [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Creating RPC server for service cinder-volume {{(pid=76339) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG cinder.service [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76339) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 13:29:50 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:50 devstack sudo[77145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:29:50 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:50 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:50 devstack sudo[77148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:50 devstack sudo[77148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:50 devstack sudo[77148]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:50 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:50 devstack sudo[77154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:29:50 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:51 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:51 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:51 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:29:51 devstack sudo[77157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:29:51 devstack sudo[77157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:29:51 devstack sudo[77157]: pam_unix(sudo:session): session closed for user root Sep 25 13:29:51 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:29:51 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-b1bca920-34bf-420a-882d-f08438b8d61a None None] Driver post RPC initialization completed successfully. Sep 25 13:29:52 devstack cinder-volume[76124]: DEBUG dbcounter [-] [76124] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:30:00 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:30:01 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:30:12 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager._thread_info {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:30:12 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread count: 6 {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:30:12 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread info: [<_MainThread(MainThread, started 140270805237888)>, , , , , ] {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:31:12 devstack sudo[79517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:31:12 devstack sudo[79517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:31:12 devstack sudo[79517]: pam_unix(sudo:session): session closed for user root Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:31:12 devstack sudo[79520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:31:12 devstack sudo[79520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:31:12 devstack sudo[79520]: pam_unix(sudo:session): session closed for user root Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:31:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:31:12 devstack sudo[79523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:31:12 devstack sudo[79523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:31:13 devstack sudo[79523]: pam_unix(sudo:session): session closed for user root Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:31:13 devstack sudo[79526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:31:13 devstack sudo[79526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:31:13 devstack sudo[79526]: pam_unix(sudo:session): session closed for user root Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG cinder.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Notifying Schedulers of capabilities ... {{(pid=76339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager._thread_info {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread count: 6 {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:31:13 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread info: [<_MainThread(MainThread, started 140270805237888)>, , , , , ] {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:32:01 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writing DB stats cinder:SELECT=1 {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:32:01 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writing DB stats cinder:UPDATE=1 {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:32:12 devstack sudo[82608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:32:12 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:32:12 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:32:12 devstack sudo[82611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:32:12 devstack sudo[82611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:32:12 devstack sudo[82611]: pam_unix(sudo:session): session closed for user root Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:32:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:32:12 devstack sudo[82630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:32:12 devstack sudo[82630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:32:13 devstack sudo[82630]: pam_unix(sudo:session): session closed for user root Sep 25 13:32:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:32:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:32:13 devstack sudo[82633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:32:13 devstack sudo[82633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:32:13 devstack sudo[82633]: pam_unix(sudo:session): session closed for user root Sep 25 13:32:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:32:13 devstack cinder-volume[76339]: DEBUG cinder.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Notifying Schedulers of capabilities ... {{(pid=76339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:33:12 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:33:12 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:33:12 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:33:12 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:33:12 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:33:12 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:33:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:33:12 devstack sudo[84659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:33:12 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:33:13 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:33:13 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:33:13 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:33:13 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG cinder.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Notifying Schedulers of capabilities ... {{(pid=76339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager._thread_info {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread count: 6 {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:33:13 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread info: [<_MainThread(MainThread, started 140270805237888)>, , , , , ] {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:34:01 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Updating volume stats {{(pid=76339) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:12 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 13:34:12 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:12 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:12 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:34:12 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:12 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:12 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:12 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 13:34:12 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:13 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.341s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:13 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 13:34:13 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:13 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG cinder.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Notifying Schedulers of capabilities ... {{(pid=76339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG oslo_service.periodic_task [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] Running periodic task VolumeManager._thread_info {{(pid=76339) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread count: 6 {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:34:13 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-c5c32418-1427-4738-952e-ef66e6ac0dc9 None None] thread info: [<_MainThread(MainThread, started 140270805237888)>, , , , , ] {{(pid=76339) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:34:35 devstack cinder-volume[76124]: INFO oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Caught SIGTERM, stopping children Sep 25 13:34:35 devstack cinder-volume[76124]: DEBUG oslo_concurrency.lockutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Acquiring lock "singleton_lock" {{(pid=76124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:34:35 devstack cinder-volume[76124]: DEBUG oslo_concurrency.lockutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Acquired lock "singleton_lock" {{(pid=76124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:34:35 devstack cinder-volume[76124]: DEBUG oslo_concurrency.lockutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Releasing lock "singleton_lock" {{(pid=76124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:34:35 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Stop services. {{(pid=76124) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 13:34:35 devstack cinder-volume[76124]: DEBUG oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Killing children. {{(pid=76124) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 13:34:35 devstack cinder-volume[76124]: INFO oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Waiting on 1 children to exit Sep 25 13:34:40 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Acquiring lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:34:40 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Acquired lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:34:40 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Releasing lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:34:40 devstack cinder-volume[76339]: WARNING amqp [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 13:34:40 devstack cinder-volume[76339]: WARNING amqp [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 13:34:40 devstack cinder-volume[76124]: INFO oslo_service.backend._eventlet.service [None req-4b1c8568-b155-48ab-9074-a88090e834bb None None] Child 76339 exited with status 0 Sep 25 13:34:40 devstack cinder-volume[86336]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 13:34:40 devstack cinder-volume[86336]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 13:34:40 devstack cinder-volume[86336]: we strongly recommend against using it for new projects. Sep 25 13:34:40 devstack cinder-volume[86336]: If you are already using Eventlet, we recommend migrating to a different Sep 25 13:34:40 devstack cinder-volume[86336]: framework. For more detail see Sep 25 13:34:40 devstack cinder-volume[86336]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 13:34:40 devstack cinder-volume[86336]: import eventlet # noqa Sep 25 13:34:42 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:34:42 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:34:42 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:34:43 devstack cinder-volume[86336]: INFO dbcounter [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Registered counter for database cinder Sep 25 13:34:43 devstack cinder-volume[86336]: DEBUG oslo_db.sqlalchemy.engines [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:34:43 devstack cinder-volume[86336]: DEBUG dbcounter [-] [86336] Writer thread running {{(pid=86336) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 13:34:43 devstack cinder-volume[86336]: INFO cinder.rpc [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 13:34:43 devstack cinder-volume[86336]: INFO cinder.rpc [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 13:34:43 devstack cinder-volume[86336]: DEBUG oslo_db.sqlalchemy.engines [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:34:43 devstack cinder-volume[86336]: INFO cinder.volume.manager [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Determined volume DB was empty at startup. Sep 25 13:34:43 devstack cinder-volume[86336]: DEBUG cinder.volume.manager [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86336) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 13:34:43 devstack cinder-volume[86336]: INFO cinder.volume.manager [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 13:34:43 devstack cinder-volume[86336]: WARNING stevedore.named [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 13:34:43 devstack cinder-volume[86336]: WARNING castellan.key_manager [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:34:43 devstack cinder-volume[86336]: WARNING cinder.keymgr.conf_key_mgr [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:34:43 devstack cinder-volume[86336]: INFO cinder.volume.manager [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_db.sqlalchemy.engines [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:34:44 devstack cinder-volume[86336]: INFO oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Starting 1 workers Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Started child 86551 {{(pid=86336) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Full set of CONF: {{(pid=86336) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] ******************************************************************************** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Configuration options gathered from: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] ================================================================================ {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 13:34:44 devstack cinder-volume[86551]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] allow_availability_zone_fallback = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] allow_compression_on_image_upload = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] allowed_direct_url_schemes = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] api_rate_limit = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] auth_strategy = keystone {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_host = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_stats_polling_interval = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backup_api_class = cinder.backup.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backup_name_template = backup-%s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backup_use_same_host = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backup_use_temp_snapshot = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] chap_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] chap_username = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_internal_tenant_project_id = 0d3d6c192e0a43b8bbb7c367817701d1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_internal_tenant_user_id = ae5054a8dec8457eae02120815ccf7b0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cluster = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] compression_format = gzip {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] compute_api_class = cinder.compute.nova.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] config_dir = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] config_source = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] control_exchange = openstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] debug = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] default_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] default_group_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] default_volume_type = QuobyteHD {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] disk_geometry = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] driver_client_cert = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] driver_client_cert_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] driver_data_namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] driver_ssl_cert_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] driver_ssl_cert_verify = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] driver_use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] enable_new_services = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] enable_unsupported_driver = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] enabled_backends = ['QuobyteHD'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] enforce_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] filter_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_api_insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_api_ssl_compression = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_ca_certificates_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_catalog_info = image:glance:publicURL {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_num_retries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance_request_timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] goodness_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] graceful_shutdown_timeout = 5 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] group_api_class = cinder.group.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] host = devstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_compress_on_upload = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_conversion_address_space_limit = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_conversion_cpu_limit = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_conversion_disable = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_introspection_address_space_limit = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_introspection_cpu_limit = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_upload_use_cinder_backend = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_upload_use_internal_tenant = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_volume_cache_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_volume_cache_max_count = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] image_volume_cache_max_size_gb = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] init_host_max_objects_retrieval = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] instance_format = [instance: %(uuid)s] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] iscsi_target_flags = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] iscsi_write_cache = on {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] iser_helper = tgtadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.remotefs [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86551) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] iser_ip_address = 192.168.122.50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] iser_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_color = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_config_append = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_dir = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_options = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_rotate_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_rotate_interval_type = days {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] log_rotation_type = none {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] max_age = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] max_logfile_count = 30 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] max_logfile_size_mb = 200 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] max_over_subscription_ratio = 20.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] message_reap_interval = 86400 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] message_ttl = 2592000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] migration_create_volume_timeout_secs = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] monkey_patch = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] monkey_patch_modules = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] my_ip = 192.168.122.50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] no_snapshot_gb_quota = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] num_iser_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] num_shell_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] num_volume_device_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] nvmeof_conn_info_version = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] nvmet_ns_id = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] nvmet_port_id = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_max_limit = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_volume_ext_list = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_volume_listen = 0.0.0.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_volume_listen_port = 8776 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_volume_use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] osapi_volume_workers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] per_volume_size_limit = -1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] periodic_fuzzy_delay = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] periodic_interval = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] project_id_regex = [0-9a-f\-]+ {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] public_endpoint = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] publish_errors = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_backup_gigabytes = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_backups = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_gigabytes = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_groups = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_snapshots = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] quota_volumes = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] rate_limit_burst = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] rate_limit_except_level = CRITICAL {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] rate_limit_interval = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] reinit_driver_count = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] replication_device = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] report_discard_supported = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] report_interval = 120 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] reservation_clean_interval = 86400 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] reservation_expire = 86400 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] reserved_image_namespaces = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] reserved_percentage = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] rpc_response_timeout = 120 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] run_external_periodic_tasks = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] scst_target_driver = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] scst_target_iqn_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_down_time = 720 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] shell_completion = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] snapshot_name_template = snapshot-%s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] state_path = /opt/stack/data/cinder {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] storage_availability_zone = nova {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] storage_protocol = iSCSI {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] syslog_log_facility = LOG_USER {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] target_helper = lioadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] target_ip_address = 192.168.122.50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] target_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] target_protocol = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] target_secondary_ip_addresses = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] trace_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] transfer_api_class = cinder.transfer.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] transport_url = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] until_refresh = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_chap_auth = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_default_quota_class = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_journal = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_json = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_stderr = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] use_syslog = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] verify_glance_signatures = enabled {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_api_class = cinder.volume.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_backend_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_clear = zero {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_clear_ionice = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_clear_size = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_copy_bps_limit = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_dd_blocksize = 1M {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_name_template = volume-%s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_service_inithost_offload = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volume_usage_audit_period = month {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] zoning_mode = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86551) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_concurrency.disable_process_locking = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86551]: WARNING cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 13:34:44 devstack cinder-volume[86551]: WARNING cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Running cmd (subprocess): mount.quobyte {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.auth_type = password {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.auth_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.cache = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.delay_auth_decision = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.http_connect_timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.include_service_catalog = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.interface = public {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcache_username = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.region_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.service_token_roles_required = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.service_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.token_cache_time = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.backend = dogpile.cache.null {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.backend_argument = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.backend_expiration_time = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.config_prefix = cache.oslo {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.debug_cache_backend = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.enable_retry_client = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.enable_socket_keepalive = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.expiration_time = 600 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.hashclient_retry_attempts = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_dead_retry = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_pool_maxsize = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_sasl_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.proxies = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.redis_db = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.redis_sentinel_service_name = mymaster {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.redis_server = localhost:6379 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.retry_attempts = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.retry_delay = 0.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.socket_keepalive_count = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.socket_keepalive_idle = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.socket_keepalive_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.socket_timeout = 1.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.tls_allowed_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.tls_cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.tls_certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.tls_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.tls_keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cache.username = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] coordination.backend_url = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.asyncio_connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.asyncio_slave_connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.backend = sqlalchemy {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.connection_debug = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.connection_parameters = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.connection_recycle_time = 3600 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.connection_trace = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.db_inc_retry_interval = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.db_max_retries = 20 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.db_max_retry_interval = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.db_retry_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.max_overflow = 50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.max_pool_size = 5 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.max_retries = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.mysql_wsrep_sync_wait = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.pool_timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.retry_interval = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.slave_connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.sqlite_synchronous = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.synchronous_reader = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] database.use_db_reconnect = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_tracing.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.connection_string = messaging:// {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.es_doc_type = notification {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.es_scroll_size = 10000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.es_scroll_time = 2m {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.filter_error_trace = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.hmac_keys = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.sentinel_service_name = mymaster {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.socket_timeout = 0.1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.trace_requests = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler.trace_sqlalchemy = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler_jaeger.process_tags = {} {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler_jaeger.service_name_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] profiler_otlp.service_name_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.enforce_new_defaults = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.policy_default_rule = default {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.policy_file = policy.yaml {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_policy.remote_timeout = 60.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.group = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.helper_command = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] privsep_osbrick.user = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.group = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.helper_command = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] cinder_sys_admin.user = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.auth_type = password {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.send_service_user_token = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] service_user.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.auth_type = password {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.region_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] glance.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.backend_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.chap_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.chap_username = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.disk_geometry = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.driver_client_cert = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.driver_client_cert_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.driver_data_namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.driver_use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.enable_unsupported_driver = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.extra_capabilities = {} {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.filter_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.goodness_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.iscsi_target_flags = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.iscsi_write_cache = on {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.iser_helper = tgtadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.iser_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_host = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_login = admin {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_mount_options = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_private_key = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_share_path = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_ssh_port = 22 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.num_shell_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.nvmet_port_id = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_client_cfg = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.quobyte_volume_url = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.replication_device = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.report_discard_supported = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.reserved_percentage = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.scst_target_driver = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.scst_target_iqn_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.storage_protocol = iSCSI {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.target_helper = tgtadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.target_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.target_protocol = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.trace_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.unique_fqdn_network = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.use_chap_auth = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_backend_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_clear = zero {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_clear_ionice = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_clear_size = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_reports.file_event_handler = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_reports.log_dir = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.backend_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.backend_host = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.chap_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.chap_username = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.chiscsi_conf = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.disk_geometry = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.driver_client_cert = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.driver_client_cert_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.driver_data_namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.driver_use_ssl = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.extra_capabilities = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.filter_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.goodness_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.iscsi_target_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.iscsi_write_cache = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.iser_helper = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.iser_ip_address = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.iser_port = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.iser_target_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_host = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_login = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_mount_options = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_private_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_share_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_ssh_port = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.num_shell_tries = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nvmet_ns_id = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.nvmet_port_id = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.replication_device = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.report_discard_supported = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.reserved_percentage = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.scst_target_driver = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.storage_protocol = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.target_helper = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.target_ip_address = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.target_port = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.target_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.target_protocol = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.trace_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.unique_fqdn_network = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.use_chap_auth = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_clear = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack quobyte-client[86552]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_clear_ionice = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_clear_size = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack quobyte-client[86552]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] QuobyteHD.volumes_dir = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] CMD "mount.quobyte" returned: 1 in 0.167s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86551]: INFO cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 ... Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d -c /etc/quobyte/client-cinder.cfg {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.ssl_version = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_notifications.driver = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_notifications.retry = -1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] oslo_messaging_notifications.transport_url = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] key_manager.fixed_key = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.barbican_api_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.barbican_endpoint = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.barbican_endpoint_type = public {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.barbican_region_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.number_of_retries = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.retry_delay = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.send_service_user_token = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.verify_ssl = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican.verify_ssl_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.auth_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] barbican_service_user.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.approle_role_id = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.approle_secret_id = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.auth_method = approle {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.auth_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.kv_mountpoint = secret {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d -c /etc/quobyte/client-cinder.cfg Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.kv_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.kv_version = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.root_token_id = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.ssl_ca_crt_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.timeout = 60.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.token_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.token_role = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:34:44 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] ******************************************************************************** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 13:34:44 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.423s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:44 devstack cinder-volume[86551]: INFO cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 succeeded Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.440s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:34:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:44 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:34:44 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:45 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.255s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:45 devstack cinder-volume[86551]: INFO cinder.volume.driver [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.volume.driver [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3816757202148, 'free_capacity_gb': 1775.3816757202148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86551) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writer thread running {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.db.api [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Building query based on filter {{(pid=86551) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.image.image_utils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86551) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 13:34:45 devstack cinder-volume[86551]: INFO cinder.keymgr.migration [None req-d31c0784-27dc-4b88-8964-e324ca48ee02 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:45 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:34:45 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:45 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.252s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Notifying Schedulers of capabilities ... {{(pid=86551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:34:45 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Driver initialization completed successfully. Sep 25 13:34:45 devstack cinder-volume[86551]: INFO cinder.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Initiating service 3 cleanup Sep 25 13:34:45 devstack cinder-volume[86551]: INFO cinder.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Service 3 cleanup completed. Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.service [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Creating RPC server for service cinder-volume {{(pid=86551) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.service [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86551) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 13:34:45 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:34:45 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:45 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:34:45 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:46 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:46 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.337s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:46 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-a1fd6cea-c9d2-4eb4-ba47-a13e964e1375 None None] Driver post RPC initialization completed successfully. Sep 25 13:34:50 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:34:50 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:34:50 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:34:50 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:34:50 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:34:50 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:34:50 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:34:50 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:34:51 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Sep 25 13:34:51 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.236s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:34:51 devstack cinder-volume[86551]: DEBUG cinder.manager [None req-46704b1a-6634-44fb-ab02-498a59343b9f None None] Notifying Schedulers of capabilities ... {{(pid=86551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:34:53 devstack cinder-volume[86336]: INFO oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Caught SIGTERM, stopping children Sep 25 13:34:53 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Acquiring lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:34:53 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Acquired lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:34:53 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Releasing lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:34:53 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Stop services. {{(pid=86336) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 13:34:53 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Killing children. {{(pid=86336) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 13:34:53 devstack cinder-volume[86336]: INFO oslo_service.backend._eventlet.service [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Waiting on 1 children to exit Sep 25 13:34:56 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:34:56 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:34:58 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 13:34:58 devstack cinder-volume[86928]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 13:34:58 devstack cinder-volume[86928]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 13:34:58 devstack cinder-volume[86928]: we strongly recommend against using it for new projects. Sep 25 13:34:58 devstack cinder-volume[86928]: If you are already using Eventlet, we recommend migrating to a different Sep 25 13:34:58 devstack cinder-volume[86928]: framework. For more detail see Sep 25 13:34:58 devstack cinder-volume[86928]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 13:34:58 devstack cinder-volume[86928]: import eventlet # noqa Sep 25 13:34:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:34:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:34:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:34:59 devstack cinder-volume[86551]: WARNING amqp [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 13:34:59 devstack cinder-volume[86551]: WARNING amqp [None req-db7b677a-294a-4309-a8e0-4ed4a85d9aef None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 13:35:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86928) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 13:35:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86928) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 13:35:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86928) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 13:35:01 devstack cinder-volume[86928]: INFO dbcounter [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Registered counter for database cinder Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_db.sqlalchemy.engines [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writer thread running {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 13:35:02 devstack cinder-volume[86928]: INFO cinder.rpc [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 13:35:02 devstack cinder-volume[86928]: INFO cinder.rpc [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_db.sqlalchemy.engines [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:35:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Determined volume DB was empty at startup. Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86928) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 13:35:02 devstack cinder-volume[86928]: WARNING stevedore.named [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 13:35:02 devstack cinder-volume[86928]: WARNING castellan.key_manager [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:35:02 devstack cinder-volume[86928]: WARNING cinder.keymgr.conf_key_mgr [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 13:35:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_db.sqlalchemy.engines [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:35:02 devstack cinder-volume[86928]: INFO oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Starting 1 workers Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Started child 87220 {{(pid=86928) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Full set of CONF: {{(pid=86928) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] ******************************************************************************** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] Configuration options gathered from: {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] ================================================================================ {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] allow_availability_zone_fallback = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] allow_compression_on_image_upload = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] allowed_direct_url_schemes = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] api_rate_limit = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] auth_strategy = keystone {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[87220]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_availability_zone = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_host = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_stats_polling_interval = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backup_api_class = cinder.backup.api.API {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backup_name_template = backup-%s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backup_use_same_host = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backup_use_temp_snapshot = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] chap_password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] chap_username = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_internal_tenant_project_id = 0d3d6c192e0a43b8bbb7c367817701d1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_internal_tenant_user_id = ae5054a8dec8457eae02120815ccf7b0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cluster = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] compression_format = gzip {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] compute_api_class = cinder.compute.nova.API {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] config_dir = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] config_source = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] control_exchange = openstack {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] debug = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] default_availability_zone = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] default_group_type = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] default_volume_type = QuobyteHD {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] disk_geometry = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] driver_client_cert = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] driver_client_cert_key = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] driver_data_namespace = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] driver_ssl_cert_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] driver_ssl_cert_verify = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] driver_use_ssl = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] enable_new_services = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] enable_unsupported_driver = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] enabled_backends = ['QuobyteHD'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] enforce_multipath_for_image_xfer = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] filter_function = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_api_insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_api_ssl_compression = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_ca_certificates_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_catalog_info = image:glance:publicURL {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_num_retries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance_request_timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] goodness_function = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] graceful_shutdown_timeout = 5 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] group_api_class = cinder.group.api.API {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] host = devstack {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_compress_on_upload = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_conversion_address_space_limit = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_conversion_cpu_limit = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_conversion_disable = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_introspection_address_space_limit = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_introspection_cpu_limit = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_upload_use_cinder_backend = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_upload_use_internal_tenant = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_volume_cache_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_volume_cache_max_count = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] image_volume_cache_max_size_gb = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] init_host_max_objects_retrieval = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] instance_format = [instance: %(uuid)s] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] iscsi_target_flags = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] iscsi_write_cache = on {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] iser_helper = tgtadm {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] iser_ip_address = 192.168.122.50 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] iser_port = 3260 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_color = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_config_append = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_dir = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_options = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_rotate_interval = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_rotate_interval_type = days {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] log_rotation_type = none {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] max_age = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] max_logfile_count = 30 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] max_logfile_size_mb = 200 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] max_over_subscription_ratio = 20.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] message_reap_interval = 86400 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87220) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] message_ttl = 2592000 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] migration_create_volume_timeout_secs = 300 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] monkey_patch = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] monkey_patch_modules = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] my_ip = 192.168.122.50 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] no_snapshot_gb_quota = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] num_iser_scan_tries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] num_shell_tries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] num_volume_device_scan_tries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] nvmeof_conn_info_version = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] nvmet_ns_id = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] nvmet_port_id = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_max_limit = 1000 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_volume_ext_list = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_volume_listen_port = 8776 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_volume_use_ssl = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] osapi_volume_workers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] per_volume_size_limit = -1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] periodic_fuzzy_delay = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] periodic_interval = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] public_endpoint = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] publish_errors = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_backup_gigabytes = 1000 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_backups = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_gigabytes = 1000 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_groups = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_snapshots = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] quota_volumes = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] rate_limit_burst = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] rate_limit_except_level = CRITICAL {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] rate_limit_interval = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] reinit_driver_count = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] replication_device = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] report_discard_supported = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] report_interval = 120 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] reservation_clean_interval = 86400 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] reservation_expire = 86400 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] reserved_image_namespaces = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] reserved_percentage = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] rpc_response_timeout = 120 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] run_external_periodic_tasks = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] scst_target_driver = iscsi {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] scst_target_iqn_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_down_time = 720 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] shell_completion = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] snapshot_name_template = snapshot-%s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] split_loggers = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] state_path = /opt/stack/data/cinder {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] storage_availability_zone = nova {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] storage_protocol = iSCSI {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] syslog_log_facility = LOG_USER {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] target_helper = lioadm {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] target_ip_address = 192.168.122.50 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] target_port = 3260 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] target_protocol = iscsi {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] target_secondary_ip_addresses = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] trace_flags = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] transport_url = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] until_refresh = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_chap_auth = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_default_quota_class = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_journal = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_json = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_multipath_for_image_xfer = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_stderr = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] use_syslog = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] verify_glance_signatures = enabled {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_api_class = cinder.volume.api.API {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_backend_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_clear = zero {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_clear_ionice = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_clear_size = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_copy_bps_limit = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_dd_blocksize = 1M {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_name_template = volume-%s {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_service_inithost_offload = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volume_usage_audit_period = month {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] zoning_mode = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_concurrency.disable_process_locking = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.auth_section = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.auth_type = password {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.auth_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.cache = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.include_service_catalog = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.interface = public {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcache_username = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.region_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.service_type = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.backend = dogpile.cache.null {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.backend_argument = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.backend_expiration_time = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.config_prefix = cache.oslo {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.debug_cache_backend = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.enable_retry_client = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.enable_socket_keepalive = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.expiration_time = 600 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.hashclient_retry_attempts = 2 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_dead_retry = 300 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_pool_maxsize = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_sasl_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.proxies = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.redis_db = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.redis_server = localhost:6379 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87220) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.retry_attempts = 2 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.retry_delay = 0.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.socket_keepalive_count = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.socket_keepalive_idle = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.socket_keepalive_interval = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.socket_timeout = 1.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.tls_allowed_ciphers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.tls_cafile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.tls_certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.tls_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.tls_keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cache.username = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] coordination.backend_url = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.asyncio_connection = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.asyncio_slave_connection = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.backend = sqlalchemy {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.connection = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Running cmd (subprocess): mount.quobyte {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.connection_debug = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.connection_parameters = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.connection_recycle_time = 3600 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.connection_trace = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.db_inc_retry_interval = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.db_max_retries = 20 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.db_max_retry_interval = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.db_retry_interval = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.max_overflow = 50 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.max_pool_size = 5 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.max_retries = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.mysql_wsrep_sync_wait = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.pool_timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.retry_interval = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.slave_connection = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.sqlite_synchronous = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.synchronous_reader = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] database.use_db_reconnect = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_tracing.insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.connection_string = messaging:// {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.es_doc_type = notification {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.es_scroll_size = 10000 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.es_scroll_time = 2m {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.filter_error_trace = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.hmac_keys = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.sentinel_service_name = mymaster {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.socket_timeout = 0.1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.trace_requests = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler.trace_sqlalchemy = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler_jaeger.process_tags = {} {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler_jaeger.service_name_prefix = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] profiler_otlp.service_name_prefix = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.enforce_new_defaults = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.policy_default_rule = default {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.policy_file = policy.yaml {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.group = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.helper_command = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] privsep_osbrick.user = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.group = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.helper_command = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] cinder_sys_admin.user = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.auth_section = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.auth_type = password {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.cafile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.collect_timing = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.send_service_user_token = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.split_loggers = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.tls_ciphers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] service_user.tls_min_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.auth_section = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.auth_type = password {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.collect_timing = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.region_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.split_loggers = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.tls_ciphers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] glance.tls_min_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.backend_availability_zone = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.chap_password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.chap_username = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.disk_geometry = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.driver_client_cert = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.driver_client_cert_key = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.driver_data_namespace = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.driver_use_ssl = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.extra_capabilities = {} {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.filter_function = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.goodness_function = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.iscsi_target_flags = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.iscsi_write_cache = on {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.iser_helper = tgtadm {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.iser_port = 3260 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_host = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_login = admin {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_mount_options = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_private_key = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_share_path = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.num_shell_tries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.quobyte_volume_url = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.replication_device = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.report_discard_supported = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.reserved_percentage = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.target_helper = tgtadm {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.target_port = 3260 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.target_protocol = iscsi {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.trace_flags = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.unique_fqdn_network = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.use_chap_auth = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_backend_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_clear = zero {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_clear_ionice = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_clear_size = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack quobyte-client[87222]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 13:35:02 devstack quobyte-client[87222]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_reports.file_event_handler = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_reports.log_dir = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.backend_availability_zone = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.backend_host = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.chap_password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.chap_username = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.chiscsi_conf = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.disk_geometry = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.driver_client_cert = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.driver_data_namespace = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.driver_use_ssl = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.extra_capabilities = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.filter_function = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.goodness_function = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.iser_helper = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.iser_ip_address = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.iser_port = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.iser_target_prefix = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_host = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_login = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_mount_options = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_password = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_private_key = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_share_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_ssh_port = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.num_shell_tries = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.nvmet_port_id = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.replication_device = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.report_discard_supported = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.reserved_percentage = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.scst_target_driver = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.storage_protocol = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.target_helper = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.target_ip_address = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.target_port = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.target_prefix = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.target_protocol = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.trace_flags = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.use_chap_auth = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_clear = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_clear_size = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] QuobyteHD.volumes_dir = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_notifications.driver = [] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_notifications.retry = -1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] key_manager.fixed_key = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.barbican_api_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.barbican_endpoint = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.barbican_endpoint_type = public {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.barbican_region_name = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.cafile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.collect_timing = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.number_of_retries = 60 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.retry_delay = 1 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.send_service_user_token = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.split_loggers = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.tls_ciphers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.tls_min_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.verify_ssl = True {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican.verify_ssl_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.auth_section = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.auth_type = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.cafile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.certfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.collect_timing = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.insecure = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.keyfile = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.split_loggers = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.timeout = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.tls_ciphers = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] barbican_service_user.tls_min_version = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.approle_role_id = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.approle_secret_id = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.auth_method = approle {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.auth_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.kv_mountpoint = secret {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.kv_path = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.kv_version = 2 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.namespace = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.root_token_id = **** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.ssl_ca_crt_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.timeout = 60.0 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.token_file = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.token_role = None {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.use_ssl = False {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 13:35:02 devstack cinder-volume[86928]: DEBUG oslo_service.backend._eventlet.service [None req-aff5b8e0-e7d6-4b76-bdda-e06724bc7230 None None] ******************************************************************************** {{(pid=86928) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 13:35:03 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.277s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.volume.driver [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Driver hasn't implemented _init_vendor_properties() Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.volume.driver [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3816757202148, 'free_capacity_gb': 1775.3816757202148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87220) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_db.sqlalchemy.engines [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writer thread running {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.db.api [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Building query based on filter {{(pid=87220) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87220) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.keymgr.migration [None req-9860bf83-a1a7-477a-97f7-0a536592f96e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 13:35:03 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:35:03 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:35:03 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.287s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Driver initialization completed successfully. Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Initiating service 3 cleanup Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Service 3 cleanup completed. Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.service [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Creating RPC server for service cinder-volume {{(pid=87220) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.service [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87220) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:35:03 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:35:03 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:35:03 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Sep 25 13:35:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.256s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:35:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-96568a65-c7c7-4205-a440-6b4d806c62da None None] Driver post RPC initialization completed successfully. Sep 25 13:35:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:35:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 6 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:35:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:35:12 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:35:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:35:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=3 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Flow 'volume_create_manager' (dede0a4d-0a82-4b5f-a37b-b36ba35fa655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1da0600-3aed-40ed-b8b0-ebfb0f563f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1da0600-3aed-40ed-b8b0-ebfb0f563f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-460931940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3077ca69-263b-470e-9d26-496b686ac629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8538deb3d5240cab02cdd719d73ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:00Z,use_quota=True,user_id='a87f06db5c644f239a250c4a6a58b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01226c7-e9f6-4819-a88a-2d42f13b239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01226c7-e9f6-4819-a88a-2d42f13b239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404fbe47-ebd6-480e-a1ff-98e8c7dfe02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404fbe47-ebd6-480e-a1ff-98e8c7dfe02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3077ca69-263b-470e-9d26-496b686ac629', 'volume_name': 'volume-3077ca69-263b-470e-9d26-496b686ac629', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b94699-dedf-42cb-9623-efa68eab1cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b94699-dedf-42cb-9623-efa68eab1cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6239a437-5b8f-4f0f-9c71-11cd088bf38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Volume 3077ca69-263b-470e-9d26-496b686ac629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3077ca69-263b-470e-9d26-496b686ac629', 'volume_size': 1} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-460931940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3077ca69-263b-470e-9d26-496b686ac629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8538deb3d5240cab02cdd719d73ab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:00Z,use_quota=True,user_id='a87f06db5c644f239a250c4a6a58b85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Creating volume 3077ca69-263b-470e-9d26-496b686ac629 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:36:00 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:36:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:00 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 1073741824 Sep 25 13:36:00 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:01 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 1073741824" returned: 0 in 0.678s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:01 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 Sep 25 13:36:01 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:01 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6239a437-5b8f-4f0f-9c71-11cd088bf38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3077ca69-263b-470e-9d26-496b686ac629', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe14ef9-11a5-4eba-8c9a-3a479bed1afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:01 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Volume volume-3077ca69-263b-470e-9d26-496b686ac629 (3077ca69-263b-470e-9d26-496b686ac629): created successfully Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe14ef9-11a5-4eba-8c9a-3a479bed1afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Flow 'volume_create_manager' (dede0a4d-0a82-4b5f-a37b-b36ba35fa655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-543b02bd-e605-44ea-8802-b4ed8429caac tempest-TaggedAttachmentsTest-2110768386 None] Created volume successfully. Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:09 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:36:09 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:10 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.516s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:36:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:36:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 6 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:36:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:36:11 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:36:11 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Flow 'volume_create_manager' (baf9c121-e89f-4488-9eab-cd21be474ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2d7192-35cb-405b-a323-a6ccb39e83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2d7192-35cb-405b-a323-a6ccb39e83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-426970105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='909d3ba6f656448b82cbbe9009d43eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:17Z,use_quota=True,user_id='a560bb48f44c4554bd431c565596a07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8402aba-6386-4988-86eb-02bd1fb2abf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8402aba-6386-4988-86eb-02bd1fb2abf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49146e4d-4be0-4f64-aff3-729196c3fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49146e4d-4be0-4f64-aff3-729196c3fc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2', 'volume_name': 'volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cba3d7d-ea7f-4652-b213-3497f498d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cba3d7d-ea7f-4652-b213-3497f498d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586d327e-3163-42e5-9864-14ecca0f291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:17 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Volume 5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2', 'volume_size': 1} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-426970105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='909d3ba6f656448b82cbbe9009d43eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:17Z,use_quota=True,user_id='a560bb48f44c4554bd431c565596a07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Creating volume 5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:36:17 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:36:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:17 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 1073741824 Sep 25 13:36:17 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:18 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 1073741824" returned: 0 in 0.966s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:18 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 Sep 25 13:36:18 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:19 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2" returned: 0 in 0.592s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586d327e-3163-42e5-9864-14ecca0f291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b636322-ac69-4751-832a-9a72bbe87230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:19 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Volume volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 (5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2): created successfully Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b636322-ac69-4751-832a-9a72bbe87230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Flow 'volume_create_manager' (baf9c121-e89f-4488-9eab-cd21be474ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0d685b4c-8e8f-4aca-9ba5-bbe758b70f0b tempest-DeleteServersTestJSON-297203004 None] Created volume successfully. Sep 25 13:36:25 devstack cinder-volume[87220]: WARNING py.warnings [req-41d53909-0004-40bc-8c05-08501fa1da58 req-f51d86bc-bb61-480f-82a1-61af6b8f8eae tempest-DeleteServersTestJSON-297203004 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 25 13:36:25 devstack cinder-volume[87220]: .first() Sep 25 13:36:25 devstack cinder-volume[87220]: Sep 25 13:36:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-41d53909-0004-40bc-8c05-08501fa1da58 req-f51d86bc-bb61-480f-82a1-61af6b8f8eae tempest-DeleteServersTestJSON-297203004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-41d53909-0004-40bc-8c05-08501fa1da58 req-f51d86bc-bb61-480f-82a1-61af6b8f8eae tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-41d53909-0004-40bc-8c05-08501fa1da58 req-f51d86bc-bb61-480f-82a1-61af6b8f8eae tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-41d53909-0004-40bc-8c05-08501fa1da58 req-f51d86bc-bb61-480f-82a1-61af6b8f8eae tempest-DeleteServersTestJSON-297203004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77218814-17db-4f08-949f-ef1165e398f7', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:36:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-41d53909-0004-40bc-8c05-08501fa1da58 req-f51d86bc-bb61-480f-82a1-61af6b8f8eae tempest-DeleteServersTestJSON-297203004 None] attachment_update completed successfully. Sep 25 13:36:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-468aebd4-4e9f-46b8-9805-e738cc239125 req-49db0575-4ad6-48da-8d93-06a4ec2786c4 tempest-DeleteServersTestJSON-297203004 None] Terminate volume connection completed successfully. Sep 25 13:36:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-468aebd4-4e9f-46b8-9805-e738cc239125 req-49db0575-4ad6-48da-8d93-06a4ec2786c4 tempest-DeleteServersTestJSON-297203004 None] Deleting attachment 77218814-17db-4f08-949f-ef1165e398f7. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:36:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Acquiring lock "cinder-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:36:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Lock "cinder-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:36:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Acquiring lock "cinder-quobyte-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:36:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Lock "cinder-quobyte-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:36:37 devstack cinder-volume[87220]: INFO oslo.privsep.daemon [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcwffbx_m/privsep.sock'] Sep 25 13:36:37 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcwffbx_m/privsep.sock Sep 25 13:36:37 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 13:36:38 devstack cinder-volume[87220]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 13:36:38 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:38 devstack cinder-volume[87220]: INFO oslo.privsep.daemon [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Spawned new privsep daemon via rootwrap Sep 25 13:36:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Accepted privsep connection to /tmp/tmpcwffbx_m/privsep.sock {{(pid=87220) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 13:36:38 devstack cinder-volume[87220]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 13:36:38 devstack cinder-volume[87220]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 13:36:38 devstack cinder-volume[87220]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 13:36:38 devstack cinder-volume[87220]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89016 Sep 25 13:36:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8001e6-1506-493a-b409-dd4000371ed5]: (2,) {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:36:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ec7177-3461-43ea-94d0-e302c3d67fb3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:36:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:38 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 Sep 25 13:36:38 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:39 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2" returned: 0 in 0.528s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:39 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2 Sep 25 13:36:39 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:39 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2" returned: 0 in 0.402s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Lock "cinder-quobyte-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2" released by "delete_volume" :: held 2.596s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:36:39 devstack cinder-volume[87220]: WARNING cinder.quota [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:36:39 devstack cinder-volume[87220]: WARNING cinder.quota [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Created reservations ['f085b66e-b24d-49db-b888-9c83a500ca66', '981db4b9-a0be-48e4-b3c8-06eacb38ee7b', '227d9fdd-94e0-4c1b-96ee-10554841869a', '127ed7e3-66e4-46e6-b0c9-ef10696c0e43'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:40 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:36:40 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:40 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.359s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:40 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:36:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Deleted volume successfully. Sep 25 13:36:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5a77a332-8da7-45cb-a809-08aee8a67c4c tempest-DeleteServersTestJSON-297203004 None] Lock "cinder-5e3d84b8-cba1-49cd-bf0a-e6bfa7a09bc2-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Flow 'volume_create_manager' (2be5eb13-2772-4b48-b78f-6a77810240b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6474370-999a-4edc-99f4-60bce83a99e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6474370-999a-4edc-99f4-60bce83a99e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1193059992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9008221c-36d9-48c1-bd84-25161275a8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af1778639947b1b73cd0ba45efcd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:44Z,use_quota=True,user_id='c26c8278a81b477582f7f01ee3562b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd63827-77aa-47da-bfbf-6e78d0f55abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd63827-77aa-47da-bfbf-6e78d0f55abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c8b494-034c-4eb5-8a69-9166b31ef37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c8b494-034c-4eb5-8a69-9166b31ef37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9008221c-36d9-48c1-bd84-25161275a8f7', 'volume_name': 'volume-9008221c-36d9-48c1-bd84-25161275a8f7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abde1a-4ff4-4e90-9be7-c32d67208617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abde1a-4ff4-4e90-9be7-c32d67208617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf792c5-c36f-4e32-8787-eb78ecca1449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:43 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Volume 9008221c-36d9-48c1-bd84-25161275a8f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9008221c-36d9-48c1-bd84-25161275a8f7', 'volume_size': 1} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1193059992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9008221c-36d9-48c1-bd84-25161275a8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af1778639947b1b73cd0ba45efcd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:44Z,use_quota=True,user_id='c26c8278a81b477582f7f01ee3562b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Creating volume 9008221c-36d9-48c1-bd84-25161275a8f7 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:36:43 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:36:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:44 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 1073741824 Sep 25 13:36:44 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:44 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 1073741824" returned: 0 in 0.663s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:44 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 Sep 25 13:36:44 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:44 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7" returned: 0 in 0.285s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:36:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf792c5-c36f-4e32-8787-eb78ecca1449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9008221c-36d9-48c1-bd84-25161275a8f7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134371ae-d0ce-4e86-b22a-82285d6293f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Volume volume-9008221c-36d9-48c1-bd84-25161275a8f7 (9008221c-36d9-48c1-bd84-25161275a8f7): created successfully Sep 25 13:36:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134371ae-d0ce-4e86-b22a-82285d6293f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Flow 'volume_create_manager' (2be5eb13-2772-4b48-b78f-6a77810240b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b81f90ba-9844-40b6-bdd7-77aa253f7c23 tempest-ServersNegativeTestJSON-1089160363 None] Created volume successfully. Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Flow 'volume_create_manager' (f5ab4e18-db02-42a2-ae48-f3690cf7c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27610b9-7d47-4054-97d1-c79cfca472fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27610b9-7d47-4054-97d1-c79cfca472fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1903945494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df836de-ac9a-4aed-9ffe-c2ec23f944a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af1778639947b1b73cd0ba45efcd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:48Z,use_quota=True,user_id='c26c8278a81b477582f7f01ee3562b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb50429-29db-4fad-8acf-16f8664e61f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb50429-29db-4fad-8acf-16f8664e61f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a44861-fdf4-4868-a2fd-7f18feb8f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a44861-fdf4-4868-a2fd-7f18feb8f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df836de-ac9a-4aed-9ffe-c2ec23f944a8', 'volume_name': 'volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c5a8d7-02bd-4969-9f41-c80e9e5be7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c5a8d7-02bd-4969-9f41-c80e9e5be7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ac5b43-52c0-47e7-a381-dc5953428b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Volume 8df836de-ac9a-4aed-9ffe-c2ec23f944a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8', 'volume_size': 1} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1903945494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df836de-ac9a-4aed-9ffe-c2ec23f944a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af1778639947b1b73cd0ba45efcd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:36:48Z,use_quota=True,user_id='c26c8278a81b477582f7f01ee3562b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Creating volume 8df836de-ac9a-4aed-9ffe-c2ec23f944a8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:36:48 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:48 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 1073741824 Sep 25 13:36:48 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:48 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 1073741824" returned: 0 in 0.519s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:48 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 Sep 25 13:36:48 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:49 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ac5b43-52c0-47e7-a381-dc5953428b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79ec88e-c3d1-4f6a-83d5-f17923ad1b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:36:49 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Volume volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 (8df836de-ac9a-4aed-9ffe-c2ec23f944a8): created successfully Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79ec88e-c3d1-4f6a-83d5-f17923ad1b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:36:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Flow 'volume_create_manager' (f5ab4e18-db02-42a2-ae48-f3690cf7c286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:36:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d4db345e-d309-4f89-8028-572853fb9f3f tempest-ServersNegativeTestJSON-1089160363 None] Created volume successfully. Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "cinder-8df836de-ac9a-4aed-9ffe-c2ec23f944a8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-8df836de-ac9a-4aed-9ffe-c2ec23f944a8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "cinder-quobyte-8df836de-ac9a-4aed-9ffe-c2ec23f944a8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-quobyte-8df836de-ac9a-4aed-9ffe-c2ec23f944a8" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f258be62-65b8-43f7-bb2e-22f7b56dbaf5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:52 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 Sep 25 13:36:52 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:52 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8" returned: 0 in 0.417s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:52 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8 Sep 25 13:36:52 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:53 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8df836de-ac9a-4aed-9ffe-c2ec23f944a8" returned: 0 in 0.334s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-quobyte-8df836de-ac9a-4aed-9ffe-c2ec23f944a8" released by "delete_volume" :: held 0.820s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Created reservations ['ef366a1a-f4b4-4e89-952f-b6e58454b788', 'e69e7d33-3d47-4c67-9912-f42a03f19805', 'f41fe64c-3ade-4538-a667-a7add3611580', '9df327f1-3f92-476b-97c3-5a10c6e2d12f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:53 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:36:53 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "cinder-9008221c-36d9-48c1-bd84-25161275a8f7-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-9008221c-36d9-48c1-bd84-25161275a8f7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "cinder-quobyte-9008221c-36d9-48c1-bd84-25161275a8f7" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-quobyte-9008221c-36d9-48c1-bd84-25161275a8f7" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:36:53 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.390s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:36:53 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Deleted volume successfully. Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee975d41-d7d4-495f-b2ac-f03521c4981f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-85163bde-c3d3-46a4-9536-e240b53783f4 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-8df836de-ac9a-4aed-9ffe-c2ec23f944a8-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:36:53 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 Sep 25 13:36:53 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:54 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7" returned: 0 in 0.566s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:54 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7 Sep 25 13:36:54 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:54 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9008221c-36d9-48c1-bd84-25161275a8f7" returned: 0 in 0.406s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-quobyte-9008221c-36d9-48c1-bd84-25161275a8f7" released by "delete_volume" :: held 1.095s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Created reservations ['7e87b0ba-5bdb-4684-a74b-4917de9c46a9', '99697eb0-93ff-48a9-9734-ad94e33bdfa1', '9b550a05-4736-4a90-b25e-180c24b2e676', '373206ea-ef62-4027-a947-eec7c799299d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:36:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:36:54 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:36:54 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:36:55 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Sep 25 13:36:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.388s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:36:55 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:36:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Deleted volume successfully. Sep 25 13:36:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5333b745-0d6f-42d8-abba-8fffe5edbd87 tempest-ServersNegativeTestJSON-1089160363 None] Lock "cinder-9008221c-36d9-48c1-bd84-25161275a8f7-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:37:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:37:09 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:37:09 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:37:10 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Sep 25 13:37:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.281s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:37:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:37:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:37:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 8 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:37:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:37:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:DELETE=5,cinder:INSERT=5 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:37:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:37:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-4bac4f11-4885-4867-a530-a2fc58563e5d req-118b910f-86fd-4fa6-9410-a98b390a03bb tempest-TaggedAttachmentsTest-2110768386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:37:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-4bac4f11-4885-4867-a530-a2fc58563e5d req-118b910f-86fd-4fa6-9410-a98b390a03bb tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:37:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-4bac4f11-4885-4867-a530-a2fc58563e5d req-118b910f-86fd-4fa6-9410-a98b390a03bb tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:37:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-4bac4f11-4885-4867-a530-a2fc58563e5d req-118b910f-86fd-4fa6-9410-a98b390a03bb tempest-TaggedAttachmentsTest-2110768386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-3077ca69-263b-470e-9d26-496b686ac629', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '671dac0a-9eba-455f-9f50-1cb60b9d2315', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:37:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-4bac4f11-4885-4867-a530-a2fc58563e5d req-118b910f-86fd-4fa6-9410-a98b390a03bb tempest-TaggedAttachmentsTest-2110768386 None] attachment_update completed successfully. Sep 25 13:37:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-52f859c5-e97c-431b-98b0-98cf626328c1 req-441ac0e0-e4b9-47e1-b0d4-71e883d6df4b tempest-TaggedAttachmentsTest-2110768386 None] Terminate volume connection completed successfully. Sep 25 13:37:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-52f859c5-e97c-431b-98b0-98cf626328c1 req-441ac0e0-e4b9-47e1-b0d4-71e883d6df4b tempest-TaggedAttachmentsTest-2110768386 None] Deleting attachment 671dac0a-9eba-455f-9f50-1cb60b9d2315. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:37:32 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:37:37 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:37:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Acquiring lock "cinder-3077ca69-263b-470e-9d26-496b686ac629-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:37:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Lock "cinder-3077ca69-263b-470e-9d26-496b686ac629-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:37:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Acquiring lock "cinder-quobyte-3077ca69-263b-470e-9d26-496b686ac629" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:37:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Lock "cinder-quobyte-3077ca69-263b-470e-9d26-496b686ac629" acquired by "delete_volume" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:37:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6c066e-48f6-481f-9a9d-971dd57d3574]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:37:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:37:55 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 Sep 25 13:37:55 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:37:56 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Sep 25 13:37:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629" returned: 0 in 0.907s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:37:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:37:56 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629 Sep 25 13:37:56 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:37:57 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Sep 25 13:37:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3077ca69-263b-470e-9d26-496b686ac629" returned: 0 in 0.844s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:37:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Lock "cinder-quobyte-3077ca69-263b-470e-9d26-496b686ac629" released by "delete_volume" :: held 1.883s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:37:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Created reservations ['22549b0f-50b6-421e-9619-a5947a4fcfb9', 'ebf76d86-474e-4d74-901c-c6fb4ebf41e2', '6a490dda-a7a7-4f98-9c65-2cac29c10acf', 'afc0adb0-a5d5-4fb8-9e63-b554f1f6b636'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:37:58 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:37:58 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:37:58 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.864s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:37:58 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:37:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Deleted volume successfully. Sep 25 13:37:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4348a808-a94a-452c-a090-afb04ed8c1ef tempest-TaggedAttachmentsTest-2110768386 None] Lock "cinder-3077ca69-263b-470e-9d26-496b686ac629-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Flow 'volume_create_manager' (896c54a1-7eec-4f65-8213-65a83635e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151cfc3a-c3b4-40a8-a1ff-765973f3cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151cfc3a-c3b4-40a8-a1ff-765973f3cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-324019222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169e4621-dd46-4b04-ab21-523d5bf6fc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6863284d10f404dac45abfdb0201bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:00Z,use_quota=True,user_id='292e01d24a3f4075a7857548184098f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a354ad05-a605-47a2-9dde-3291997f8495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a354ad05-a605-47a2-9dde-3291997f8495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447adf88-4b87-430e-8170-0516c7fded6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447adf88-4b87-430e-8170-0516c7fded6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '169e4621-dd46-4b04-ab21-523d5bf6fc5c', 'volume_name': 'volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fd8ab0-da78-4844-a796-4d8695f29ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fd8ab0-da78-4844-a796-4d8695f29ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b375a51b-97b5-43bf-96ac-1d96fd56b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Volume 169e4621-dd46-4b04-ab21-523d5bf6fc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c', 'volume_size': 1} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-324019222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169e4621-dd46-4b04-ab21-523d5bf6fc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6863284d10f404dac45abfdb0201bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:00Z,use_quota=True,user_id='292e01d24a3f4075a7857548184098f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Creating volume 169e4621-dd46-4b04-ab21-523d5bf6fc5c {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:38:00 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:38:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:00 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c 1073741824 Sep 25 13:38:00 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:01 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c 1073741824" returned: 0 in 1.017s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:01 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c Sep 25 13:38:01 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:01 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c" returned: 0 in 0.514s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b375a51b-97b5-43bf-96ac-1d96fd56b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24658b5-22e4-4c7c-a9f8-4691d750dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:01 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Volume volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c (169e4621-dd46-4b04-ab21-523d5bf6fc5c): created successfully Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24658b5-22e4-4c7c-a9f8-4691d750dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Flow 'volume_create_manager' (896c54a1-7eec-4f65-8213-65a83635e96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f334223b-8142-4ea0-a627-333f6cb8186c tempest-VolumesAdminNegativeTest-384711827 None] Created volume successfully. Sep 25 13:38:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Acquiring lock "cinder-169e4621-dd46-4b04-ab21-523d5bf6fc5c-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:38:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Lock "cinder-169e4621-dd46-4b04-ab21-523d5bf6fc5c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:38:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Acquiring lock "cinder-quobyte-169e4621-dd46-4b04-ab21-523d5bf6fc5c" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:38:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Lock "cinder-quobyte-169e4621-dd46-4b04-ab21-523d5bf6fc5c" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:38:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7421501c-aa12-4a3f-ac2c-a108f55c4776]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:38:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:04 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c Sep 25 13:38:04 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:05 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c" returned: 0 in 0.919s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:05 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c Sep 25 13:38:05 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:05 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-169e4621-dd46-4b04-ab21-523d5bf6fc5c" returned: 0 in 0.473s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Lock "cinder-quobyte-169e4621-dd46-4b04-ab21-523d5bf6fc5c" released by "delete_volume" :: held 1.500s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Flow 'volume_create_manager' (835dfa0c-8293-4aae-883f-088107a7c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcbb641-0ddc-4f53-b101-276f39d1a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcbb641-0ddc-4f53-b101-276f39d1a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1195961517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c2578d-78f5-4454-a216-d704bc16005e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68737eb2e4e4777a52294992700c4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:06Z,use_quota=True,user_id='0d2f5faaf02943acab4df128a494241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df6fe12-57fe-430a-89d4-6d3d2b71217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df6fe12-57fe-430a-89d4-6d3d2b71217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c575fed7-e501-4633-bbbe-974e37a6ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c575fed7-e501-4633-bbbe-974e37a6ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c2578d-78f5-4454-a216-d704bc16005e', 'volume_name': 'volume-f1c2578d-78f5-4454-a216-d704bc16005e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f066ea13-1dc1-4fdf-8f80-e44bf66db877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f066ea13-1dc1-4fdf-8f80-e44bf66db877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81cdff-7336-4807-bc73-1b20e7f9554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Volume f1c2578d-78f5-4454-a216-d704bc16005e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c2578d-78f5-4454-a216-d704bc16005e', 'volume_size': 1} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1195961517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c2578d-78f5-4454-a216-d704bc16005e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68737eb2e4e4777a52294992700c4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:06Z,use_quota=True,user_id='0d2f5faaf02943acab4df128a494241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Creating volume f1c2578d-78f5-4454-a216-d704bc16005e {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:38:05 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:05 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e 1073741824 Sep 25 13:38:05 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Created reservations ['e279eb19-b10f-483f-a652-17cfe8db0c82', '51a68311-da61-41f0-aeb1-47aa0d0914e8', '66a4769c-649a-4620-a374-2d9aa03216bb', 'ee6226f5-d955-4eab-a343-31b0aa988f88'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:06 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:38:06 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:06 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.554s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:38:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Deleted volume successfully. Sep 25 13:38:06 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e 1073741824" returned: 0 in 1.040s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bda84e64-6b72-40f2-9929-2a05fd920139 tempest-VolumesAdminNegativeTest-384711827 None] Lock "cinder-169e4621-dd46-4b04-ab21-523d5bf6fc5c-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:38:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:06 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e Sep 25 13:38:06 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:07 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e" returned: 0 in 0.489s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81cdff-7336-4807-bc73-1b20e7f9554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c2578d-78f5-4454-a216-d704bc16005e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5820e42e-8f1f-4298-b24e-e29a2bf264a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Volume volume-f1c2578d-78f5-4454-a216-d704bc16005e (f1c2578d-78f5-4454-a216-d704bc16005e): created successfully Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5820e42e-8f1f-4298-b24e-e29a2bf264a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Flow 'volume_create_manager' (835dfa0c-8293-4aae-883f-088107a7c277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1a04e6a7-b260-4fdd-b55b-0e654b2b7a7e tempest-ServerActionsTestOtherA-1622259837 None] Created volume successfully. Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:09 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:38:09 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:10 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:38:17 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:38:17 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Flow 'volume_create_manager' (fac5d689-95cb-4af3-a26e-f3afa5495ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a08c0bf-bf7d-45c6-8f75-340fd19f0170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a08c0bf-bf7d-45c6-8f75-340fd19f0170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-35685504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326e1694-bfe9-4713-abf0-f0b83b5ea10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbf75c1175d46a1814421605a86bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:21Z,use_quota=True,user_id='124a8d209f8e4ab8a41656c92c5fdc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f372848f-a5a1-4982-b2b5-d603b261428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f372848f-a5a1-4982-b2b5-d603b261428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab493b0-57d7-47ca-aecf-e3c82d593fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab493b0-57d7-47ca-aecf-e3c82d593fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326e1694-bfe9-4713-abf0-f0b83b5ea10e', 'volume_name': 'volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f07f084-ae1f-4a51-912c-81eeb7311313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f07f084-ae1f-4a51-912c-81eeb7311313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92133ab7-0e2b-4ad7-a3ab-5eca7bd3620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:20 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Volume 326e1694-bfe9-4713-abf0-f0b83b5ea10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e', 'volume_size': 1} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-35685504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326e1694-bfe9-4713-abf0-f0b83b5ea10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbf75c1175d46a1814421605a86bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:21Z,use_quota=True,user_id='124a8d209f8e4ab8a41656c92c5fdc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Creating volume 326e1694-bfe9-4713-abf0-f0b83b5ea10e {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:38:20 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:38:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:20 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e 1073741824 Sep 25 13:38:20 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:21 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e 1073741824" returned: 0 in 0.824s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:21 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e Sep 25 13:38:21 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:22 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e" returned: 0 in 0.411s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92133ab7-0e2b-4ad7-a3ab-5eca7bd3620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab19795-f269-4f71-ba3d-df25bbb801ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Volume volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e (326e1694-bfe9-4713-abf0-f0b83b5ea10e): created successfully Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab19795-f269-4f71-ba3d-df25bbb801ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Flow 'volume_create_manager' (fac5d689-95cb-4af3-a26e-f3afa5495ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-64eb9c64-d05a-451f-9234-e77f4dac3ec2 tempest-AttachVolumeNegativeTest-767953356 None] Created volume successfully. Sep 25 13:38:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-8bd2108a-cda7-4a6c-91e4-108124033c25 req-870ba4be-189e-46bf-9da1-cc8e94a58d39 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-8bd2108a-cda7-4a6c-91e4-108124033c25 req-870ba4be-189e-46bf-9da1-cc8e94a58d39 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-8bd2108a-cda7-4a6c-91e4-108124033c25 req-870ba4be-189e-46bf-9da1-cc8e94a58d39 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-8bd2108a-cda7-4a6c-91e4-108124033c25 req-870ba4be-189e-46bf-9da1-cc8e94a58d39 tempest-AttachVolumeNegativeTest-767953356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7292a989-88f7-47f7-8e2f-c75f67d57e1b', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:38:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-8bd2108a-cda7-4a6c-91e4-108124033c25 req-870ba4be-189e-46bf-9da1-cc8e94a58d39 tempest-AttachVolumeNegativeTest-767953356 None] attachment_update completed successfully. Sep 25 13:38:34 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:38:34 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:38:42 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:38:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Flow 'volume_create_manager' (3ce5c18e-0ea9-4969-b293-d91ec1992f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39031fd8-8e45-4a51-8f7b-313318a76745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39031fd8-8e45-4a51-8f7b-313318a76745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1786318045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5451266-deeb-44da-917e-d3f918431ca5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='722ded50eb364dd1a47e9e7e76a8852e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:43Z,use_quota=True,user_id='de8b33d46d63463abaff11b05de53fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e655e9-04c4-417d-9947-2a15f71cd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e655e9-04c4-417d-9947-2a15f71cd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec68c28e-ad78-4b68-b269-354694417eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec68c28e-ad78-4b68-b269-354694417eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5451266-deeb-44da-917e-d3f918431ca5', 'volume_name': 'volume-c5451266-deeb-44da-917e-d3f918431ca5', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c1b396-68e9-464b-8960-b0be49d2c112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c1b396-68e9-464b-8960-b0be49d2c112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f064f9-b5a0-4548-aea0-78ffe2f84de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:43 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Volume c5451266-deeb-44da-917e-d3f918431ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5451266-deeb-44da-917e-d3f918431ca5', 'volume_size': 1} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1786318045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5451266-deeb-44da-917e-d3f918431ca5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='722ded50eb364dd1a47e9e7e76a8852e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:38:43Z,use_quota=True,user_id='de8b33d46d63463abaff11b05de53fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Creating volume c5451266-deeb-44da-917e-d3f918431ca5 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:38:43 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:43 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 1073741824 Sep 25 13:38:43 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:43 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 1073741824" returned: 0 in 0.555s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:43 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 Sep 25 13:38:43 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:43 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5" returned: 0 in 0.297s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f064f9-b5a0-4548-aea0-78ffe2f84de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5451266-deeb-44da-917e-d3f918431ca5', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a6bcf1-59c8-4690-9204-71009d217f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:38:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Volume volume-c5451266-deeb-44da-917e-d3f918431ca5 (c5451266-deeb-44da-917e-d3f918431ca5): created successfully Sep 25 13:38:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a6bcf1-59c8-4690-9204-71009d217f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:38:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Flow 'volume_create_manager' (3ce5c18e-0ea9-4969-b293-d91ec1992f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:38:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-88ad119b-27cd-4037-b8f6-c5168269255c req-08f62567-725a-4a07-91d4-13ea723b2f61 tempest-VolumesGetTestJSON-584166735 None] Created volume successfully. Sep 25 13:38:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-79bfa18c-b792-49d6-9fd8-2f836cbfebb2 req-c2242fe5-0e92-4137-a6b3-26e9f8048b1d tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-79bfa18c-b792-49d6-9fd8-2f836cbfebb2 req-c2242fe5-0e92-4137-a6b3-26e9f8048b1d tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-79bfa18c-b792-49d6-9fd8-2f836cbfebb2 req-c2242fe5-0e92-4137-a6b3-26e9f8048b1d tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-79bfa18c-b792-49d6-9fd8-2f836cbfebb2 req-c2242fe5-0e92-4137-a6b3-26e9f8048b1d tempest-ServerActionsTestOtherA-1622259837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-f1c2578d-78f5-4454-a216-d704bc16005e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea8f46ce-9a42-4899-bb6f-daeed5005a61', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:38:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-79bfa18c-b792-49d6-9fd8-2f836cbfebb2 req-c2242fe5-0e92-4137-a6b3-26e9f8048b1d tempest-ServerActionsTestOtherA-1622259837 None] attachment_update completed successfully. Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Acquiring lock "cinder-c5451266-deeb-44da-917e-d3f918431ca5-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Lock "cinder-c5451266-deeb-44da-917e-d3f918431ca5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Acquiring lock "cinder-quobyte-c5451266-deeb-44da-917e-d3f918431ca5" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Lock "cinder-quobyte-c5451266-deeb-44da-917e-d3f918431ca5" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2fe3c-f116-4a2a-bcdb-dec4b72643b9]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:46 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 Sep 25 13:38:46 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:46 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5" returned: 0 in 0.603s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:46 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5 Sep 25 13:38:46 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:47 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c5451266-deeb-44da-917e-d3f918431ca5" returned: 0 in 0.709s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Lock "cinder-quobyte-c5451266-deeb-44da-917e-d3f918431ca5" released by "delete_volume" :: held 1.431s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:38:47 devstack cinder-volume[87220]: DEBUG cinder.quota [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Created reservations ['f0d9f5ec-43b4-4931-a576-c9591f823889', '88743c31-3d3b-4cc4-94ac-41be282437e4', '94549431-4b04-46ce-a004-4878a821a93f', '55b8f7e3-f182-48ef-9bce-be45f2367468'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:38:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:38:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:38:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:38:48 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:38:48 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:38:48 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Sep 25 13:38:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:38:48 devstack cinder-volume[87220]: DEBUG cinder.manager [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:38:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Deleted volume successfully. Sep 25 13:38:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-147c2f3f-ec72-4f18-909d-80b440aa9039 req-ceae7b29-b433-4894-ac29-5fd29d7fc7f9 tempest-VolumesGetTestJSON-584166735 None] Lock "cinder-c5451266-deeb-44da-917e-d3f918431ca5-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:38:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-7b8b8172-e326-4184-9b3b-5967e9e83912 tempest-ServerActionsTestOtherA-1622259837 None] Terminate volume connection completed successfully. Sep 25 13:38:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-7b8b8172-e326-4184-9b3b-5967e9e83912 tempest-ServerActionsTestOtherA-1622259837 None] Deleting attachment ea8f46ce-9a42-4899-bb6f-daeed5005a61. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:38:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-5a244b7d-96dd-40ad-91d0-82df4d8672f4 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:38:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-5a244b7d-96dd-40ad-91d0-82df4d8672f4 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:38:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-5a244b7d-96dd-40ad-91d0-82df4d8672f4 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:38:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-5a244b7d-96dd-40ad-91d0-82df4d8672f4 tempest-ServerActionsTestOtherA-1622259837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-f1c2578d-78f5-4454-a216-d704bc16005e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8129e3f6-7eff-419c-82aa-3f851ae39bed', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:38:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-7d40dbf4-0856-4c82-939a-c8cdb6cd4953 req-5a244b7d-96dd-40ad-91d0-82df4d8672f4 tempest-ServerActionsTestOtherA-1622259837 None] attachment_update completed successfully. Sep 25 13:39:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ff2651e9-13c3-4ad3-8d6f-14fa9ca75e43 tempest-BackendsCapabilitiesAdminTestsJSON-1235748448 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3816757202148, 'free_capacity_gb': 1775.3816757202148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87220) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 13:39:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-70e093c0-71c5-4501-aa51-43a77f8dc534 tempest-BackendsCapabilitiesAdminTestsJSON-1235748448 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3816757202148, 'free_capacity_gb': 1775.3816757202148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87220) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:09 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:39:09 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:10 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.593s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:39:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:39:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 8 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:39:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Flow 'volume_create_manager' (5203ba8d-048a-41ac-9ba2-7bdf415c0eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6250e6e4-b94e-407c-9089-5deb8ee1eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6250e6e4-b94e-407c-9089-5deb8ee1eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-121680262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6979e71-aecc-41ef-af65-6e4941fc699d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d12b991e0848dba859a0245cd2f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:11Z,use_quota=True,user_id='1668af0cfdae4f5c941b8b2c5bfa59b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5958b-5171-44a0-b9e1-d67df91e3de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5958b-5171-44a0-b9e1-d67df91e3de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd589394-d180-48c6-b8c7-d6aa838989b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd589394-d180-48c6-b8c7-d6aa838989b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6979e71-aecc-41ef-af65-6e4941fc699d', 'volume_name': 'volume-a6979e71-aecc-41ef-af65-6e4941fc699d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f630ac-248e-41f4-80d6-e1a9b623a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f630ac-248e-41f4-80d6-e1a9b623a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cea6bc-278a-48fd-ab4b-c3321c68ab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Volume a6979e71-aecc-41ef-af65-6e4941fc699d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6979e71-aecc-41ef-af65-6e4941fc699d', 'volume_size': 1} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-121680262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6979e71-aecc-41ef-af65-6e4941fc699d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d12b991e0848dba859a0245cd2f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:11Z,use_quota=True,user_id='1668af0cfdae4f5c941b8b2c5bfa59b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Creating volume a6979e71-aecc-41ef-af65-6e4941fc699d {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:39:11 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:39:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:11 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d 1073741824 Sep 25 13:39:11 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:12 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d 1073741824" returned: 0 in 0.593s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:12 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d Sep 25 13:39:12 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:12 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d" returned: 0 in 0.347s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cea6bc-278a-48fd-ab4b-c3321c68ab7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6979e71-aecc-41ef-af65-6e4941fc699d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d6942a-9b9b-450c-b8c9-bf3bd9a0c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Volume volume-a6979e71-aecc-41ef-af65-6e4941fc699d (a6979e71-aecc-41ef-af65-6e4941fc699d): created successfully Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d6942a-9b9b-450c-b8c9-bf3bd9a0c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Flow 'volume_create_manager' (5203ba8d-048a-41ac-9ba2-7bdf415c0eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e1d51bc3-933c-4db8-9d3c-3a77254d6119 tempest-ServerRescueNegativeTestJSON-398579117 None] Created volume successfully. Sep 25 13:39:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-38a2ac30-6dd7-480e-a3c1-ad140233c232 tempest-GroupSnapshotsV319Test-2044918827 None] Group tempest-GroupSnapshotsV319Test-Group-181609970: creating Sep 25 13:39:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-38a2ac30-6dd7-480e-a3c1-ad140233c232 tempest-GroupSnapshotsV319Test-2044918827 None] Group tempest-GroupSnapshotsV319Test-Group-181609970: created successfully Sep 25 13:39:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-38a2ac30-6dd7-480e-a3c1-ad140233c232 tempest-GroupSnapshotsV319Test-2044918827 None] Create group completed successfully. Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Flow 'volume_create_manager' (a907d44b-6d70-489a-a37a-a6f4302b2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2df224-80de-4fc6-b800-8e4ae567ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2df224-80de-4fc6-b800-8e4ae567ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858190387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d70e7c9-5a58-4ea7-955e-3aeb5001f9ed,host='devstack@QuobyteHD#QuobyteHD',id=938a119b-c88d-4fd5-8d62-37aaf48dc2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b45af9d0d44d0b8658360415e7266b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:18Z,use_quota=True,user_id='dc1abe30cb8e480c9297cf827dad3501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(428b4cc6-05c4-4a2d-9417-b9ee886c15ca),volume_type_id=428b4cc6-05c4-4a2d-9417-b9ee886c15ca)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecca7931-96f0-4b5a-92bc-d7dc475434ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecca7931-96f0-4b5a-92bc-d7dc475434ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e0f058-852d-4adf-867c-117b3a4f4f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e0f058-852d-4adf-867c-117b3a4f4f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938a119b-c88d-4fd5-8d62-37aaf48dc2e4', 'volume_name': 'volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5dcf89-ca87-4043-b877-bb544e611b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5dcf89-ca87-4043-b877-bb544e611b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa2a298-c656-43c9-bad6-eff074e167e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:18 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Volume 938a119b-c88d-4fd5-8d62-37aaf48dc2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4', 'volume_size': 1} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d70e7c9-5a58-4ea7-955e-3aeb5001f9ed,created_at=2026-09-25T11:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858190387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d70e7c9-5a58-4ea7-955e-3aeb5001f9ed,host='devstack@QuobyteHD#QuobyteHD',id=938a119b-c88d-4fd5-8d62-37aaf48dc2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b45af9d0d44d0b8658360415e7266b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:18Z,use_quota=True,user_id='dc1abe30cb8e480c9297cf827dad3501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(428b4cc6-05c4-4a2d-9417-b9ee886c15ca),volume_type_id=428b4cc6-05c4-4a2d-9417-b9ee886c15ca)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Creating volume 938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:39:18 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:18 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 1073741824 Sep 25 13:39:18 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:18 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 1073741824" returned: 0 in 0.621s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:18 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 Sep 25 13:39:18 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:19 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" returned: 0 in 0.406s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa2a298-c656-43c9-bad6-eff074e167e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea4c628-b39d-4257-b1a2-89a9d2be9224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:19 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Volume volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 (938a119b-c88d-4fd5-8d62-37aaf48dc2e4): created successfully Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea4c628-b39d-4257-b1a2-89a9d2be9224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Flow 'volume_create_manager' (a907d44b-6d70-489a-a37a-a6f4302b2471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-523dd6fd-6911-45db-9878-b3e204f57c05 tempest-GroupSnapshotsV319Test-2044918827 None] Created volume successfully. Sep 25 13:39:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] GroupSnapshot 8eddbb3a-c5ac-4f06-9862-8408e81ebf30: creating. Sep 25 13:39:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Group snapshot 8eddbb3a-c5ac-4f06-9862-8408e81ebf30: creating. {{(pid=87220) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 13:39:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Creating offline snapshot 5fb5f205-67a0-4893-b710-27b9abf652bc of volume 938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:39:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0ae992-8c91-4bec-b0a5-6b4cd07e9b4c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:21 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 Sep 25 13:39:21 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:22 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" returned: 0 in 0.493s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:22 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc 1G Sep 25 13:39:22 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:22 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc 1G" returned: 0 in 0.633s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:22 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc Sep 25 13:39:22 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:23 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:23 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:39:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:23 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc Sep 25 13:39:23 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:23 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:23 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info Sep 25 13:39:23 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:23 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info" returned: 0 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:23 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:39:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:23 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info Sep 25 13:39:23 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:24 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.info" returned: 0 in 0.345s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0909fe6d-e94b-4d0e-8bbd-9c871f76ddb4 tempest-GroupSnapshotsV319Test-2044918827 None] group_snapshot 8eddbb3a-c5ac-4f06-9862-8408e81ebf30: created successfully Sep 25 13:39:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] group_snapshot 8eddbb3a-c5ac-4f06-9862-8408e81ebf30: deleting Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] group_snapshot 8eddbb3a-c5ac-4f06-9862-8408e81ebf30: deleting {{(pid=87220) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "cinder-quobyte-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Lock "cinder-quobyte-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "cinder-quobyte-5fb5f205-67a0-4893-b710-27b9abf652bc" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Lock "cinder-quobyte-5fb5f205-67a0-4893-b710-27b9abf652bc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Deleting offline snapshot 5fb5f205-67a0-4893-b710-27b9abf652bc of volume 938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] snapshot_file for this snap is: volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5572c8-10c5-4faf-9661-cb2b39034362]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Acquiring lock "cinder-a6979e71-aecc-41ef-af65-6e4941fc699d-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "cinder-a6979e71-aecc-41ef-af65-6e4941fc699d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Acquiring lock "cinder-quobyte-a6979e71-aecc-41ef-af65-6e4941fc699d" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "cinder-quobyte-a6979e71-aecc-41ef-af65-6e4941fc699d" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[03207480-dac7-4537-8f51-1b42065002d5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:25 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc Sep 25 13:39:25 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:25 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d Sep 25 13:39:25 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:26 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc" returned: 0 in 0.519s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81efc7e-3bb7-4343-a13d-60af5a105849]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:26 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d" returned: 0 in 0.489s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:26 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d Sep 25 13:39:26 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 Sep 25 13:39:26 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:26 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:26 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a6979e71-aecc-41ef-af65-6e4941fc699d" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "cinder-quobyte-a6979e71-aecc-41ef-af65-6e4941fc699d" released by "delete_volume" :: held 0.849s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Created reservations ['fe3b4813-be96-43e1-a095-8fda3a6fc0c8', '6d8f787c-db06-438d-8c2f-f8c0253cbaf4', '973dbeb3-22a1-4f45-9ae9-df0b7fd4b8fd', 'c8c54061-4bfb-47b1-9b94-7b675db67799'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:26 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" returned: 0 in 0.507s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:26 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc Sep 25 13:39:26 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:26 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:39:26 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:27 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.448s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:39:27 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Deleted volume successfully. Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc" returned: 0 in 0.538s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:27 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc Sep 25 13:39:27 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-86020ccd-6122-4464-a6a1-7e2bdbea6180 tempest-ServerRescueNegativeTestJSON-398579117 None] Lock "cinder-a6979e71-aecc-41ef-af65-6e4941fc699d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:27 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4.5fb5f205-67a0-4893-b710-27b9abf652bc" returned: 0 in 0.305s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Lock "cinder-quobyte-5fb5f205-67a0-4893-b710-27b9abf652bc" released by "_delete_snapshot" :: held 2.007s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Lock "cinder-quobyte-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" released by "delete_snapshot" :: held 2.029s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:27 devstack cinder-volume[87220]: WARNING cinder.quota [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1971447108 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1971447108, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:39:27 devstack cinder-volume[87220]: WARNING cinder.quota [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1971447108 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1971447108, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:39:27 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] Created reservations ['5f2f7e09-3cd9-4dcd-818c-9e788ca3e6cc', '0c10bdab-4c6a-4101-9163-7e59eb36ef47', '463075bb-afe2-432b-ae8d-c0baafdfd364', 'de131cd1-016c-4ede-8cbe-e3cf0bfa334d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b2c9f320-a27e-4c3a-b000-6d7cc3efee7e tempest-GroupSnapshotsV319Test-2044918827 None] group_snapshot 8eddbb3a-c5ac-4f06-9862-8408e81ebf30: deleted successfully Sep 25 13:39:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "cinder-quobyte-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Lock "cinder-quobyte-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:28 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8137c-98b3-4175-84dd-79ad8b27c666]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:28 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 Sep 25 13:39:28 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:29 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" returned: 0 in 0.605s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:29 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4 Sep 25 13:39:29 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:29 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" returned: 0 in 0.303s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Lock "cinder-quobyte-938a119b-c88d-4fd5-8d62-37aaf48dc2e4" released by "delete_volume" :: held 0.998s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Created reservations ['b4877f5f-b0a8-452c-b87d-8cd416772c75'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:29 devstack cinder-volume[87220]: WARNING cinder.quota [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1971447108 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1971447108, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Created reservations ['07d3cb24-119d-4c5c-9b74-5b00814e8184', 'c52605b6-ce18-4f88-a466-396c96d864ea', '172b98a3-810c-42c6-8aeb-2ee3bafe8fd1', '17077450-e987-4e2c-9fd6-c2c5b40f5e04'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:29 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:39:29 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:29 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:30 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:39:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-542e2131-09b1-446d-a77f-016487186aac tempest-GroupSnapshotsV319Test-2044918827 None] Delete group completed successfully. Sep 25 13:39:39 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:39:39 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=49,cinder:SELECT=56,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:39:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-5dd6a982-f849-4ac8-85e6-410377b9ee46 req-4480af49-6504-4890-9c46-a024de49cdd6 tempest-AttachVolumeNegativeTest-767953356 None] Terminate volume connection completed successfully. Sep 25 13:39:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-5dd6a982-f849-4ac8-85e6-410377b9ee46 req-4480af49-6504-4890-9c46-a024de49cdd6 tempest-AttachVolumeNegativeTest-767953356 None] Deleting attachment 7292a989-88f7-47f7-8e2f-c75f67d57e1b. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:39:43 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:39:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Flow 'volume_create_manager' (e90016ca-9afb-490a-9cf1-d6ae5aeca110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035a85f4-13eb-4882-9ba7-0a9bf95138e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035a85f4-13eb-4882-9ba7-0a9bf95138e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-440783805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45746499-2081-4dd9-b17f-b6160b1e54ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55953b827e6b4c04ade522b198480e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:44Z,use_quota=True,user_id='2b5e101a02fc4d9da1dadc44acc8281d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e6d669-1cde-484d-93cd-f0f5f70e681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e6d669-1cde-484d-93cd-f0f5f70e681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5f400d-4a03-46ce-9299-80d058772c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5f400d-4a03-46ce-9299-80d058772c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45746499-2081-4dd9-b17f-b6160b1e54ab', 'volume_name': 'volume-45746499-2081-4dd9-b17f-b6160b1e54ab', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5628f920-9edc-429f-912e-ab293c930849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5628f920-9edc-429f-912e-ab293c930849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1558a59a-1ea1-4126-89db-22c04eb518e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Volume 45746499-2081-4dd9-b17f-b6160b1e54ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45746499-2081-4dd9-b17f-b6160b1e54ab', 'volume_size': 1} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-440783805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45746499-2081-4dd9-b17f-b6160b1e54ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55953b827e6b4c04ade522b198480e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:44Z,use_quota=True,user_id='2b5e101a02fc4d9da1dadc44acc8281d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Creating volume 45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:39:44 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:44 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab 1073741824 Sep 25 13:39:44 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:44 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab 1073741824" returned: 0 in 0.757s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:44 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab Sep 25 13:39:44 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:45 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1558a59a-1ea1-4126-89db-22c04eb518e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45746499-2081-4dd9-b17f-b6160b1e54ab', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1845a1-f7a5-4ebc-a232-69656f4bb0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Volume volume-45746499-2081-4dd9-b17f-b6160b1e54ab (45746499-2081-4dd9-b17f-b6160b1e54ab): created successfully Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1845a1-f7a5-4ebc-a232-69656f4bb0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Flow 'volume_create_manager' (e90016ca-9afb-490a-9cf1-d6ae5aeca110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-bf78dce0-f56a-4179-a88a-d2eaa316525c req-b3abbe00-5ece-4c3c-b304-7a2de854ac0d tempest-VolumesSnapshotsTestJSON-548013941 None] Created volume successfully. Sep 25 13:39:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-4250af32-de36-4025-a82e-ab5a8288c8ee req-e9f313bc-d4f7-4ada-bf30-b6df60e28ea9 tempest-ServerActionsTestOtherA-1622259837 None] Terminate volume connection completed successfully. Sep 25 13:39:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-4250af32-de36-4025-a82e-ab5a8288c8ee req-e9f313bc-d4f7-4ada-bf30-b6df60e28ea9 tempest-ServerActionsTestOtherA-1622259837 None] Deleting attachment 8129e3f6-7eff-419c-82aa-3f851ae39bed. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:39:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Creating offline snapshot dcbec3ae-9914-408a-aa03-6ec8e903a869 of volume 45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:39:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c31548c-9088-4d8d-923f-97a8e7dd06c1]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:46 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab Sep 25 13:39:46 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:47 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab" returned: 0 in 0.729s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:47 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 1G Sep 25 13:39:47 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:48 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 1G" returned: 0 in 0.650s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45746499-2081-4dd9-b17f-b6160b1e54ab -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:48 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45746499-2081-4dd9-b17f-b6160b1e54ab -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 Sep 25 13:39:48 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e06f7fee-7e18-4def-9366-616b7a50783c tempest-GroupsTest-464726452 None] Group tempest-Group1-1339677824: creating Sep 25 13:39:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e06f7fee-7e18-4def-9366-616b7a50783c tempest-GroupsTest-464726452 None] Group tempest-Group1-1339677824: created successfully Sep 25 13:39:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e06f7fee-7e18-4def-9366-616b7a50783c tempest-GroupsTest-464726452 None] Create group completed successfully. Sep 25 13:39:48 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45746499-2081-4dd9-b17f-b6160b1e54ab -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869" returned: 0 in 0.460s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:48 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 is being set with open permissions: ugo+rw Sep 25 13:39:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:48 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 Sep 25 13:39:48 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:48 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869" returned: 0 in 0.336s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:48 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info Sep 25 13:39:48 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:49 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info" returned: 0 in 0.290s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:49 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info is being set with open permissions: ugo+rw Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:49 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info Sep 25 13:39:49 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:49 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.info" returned: 0 in 0.351s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-75235afe-6b48-436a-8aa5-aba34328c5d9 tempest-GroupsTest-464726452 None] Group tempest-Group2-797324915: creating Sep 25 13:39:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-40485226-6eaa-4c57-95af-57aac411b4e1 req-cb3fac9d-c444-416f-bed5-8317da7a99b5 tempest-VolumesSnapshotsTestJSON-548013941 None] Create snapshot completed successfully Sep 25 13:39:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-75235afe-6b48-436a-8aa5-aba34328c5d9 tempest-GroupsTest-464726452 None] Group tempest-Group2-797324915: created successfully Sep 25 13:39:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-75235afe-6b48-436a-8aa5-aba34328c5d9 tempest-GroupsTest-464726452 None] Create group completed successfully. Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "cinder-dcbec3ae-9914-408a-aa03-6ec8e903a869-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-dcbec3ae-9914-408a-aa03-6ec8e903a869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "cinder-quobyte-45746499-2081-4dd9-b17f-b6160b1e54ab" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-quobyte-45746499-2081-4dd9-b17f-b6160b1e54ab" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "cinder-quobyte-dcbec3ae-9914-408a-aa03-6ec8e903a869" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-quobyte-dcbec3ae-9914-408a-aa03-6ec8e903a869" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Deleting offline snapshot dcbec3ae-9914-408a-aa03-6ec8e903a869 of volume 45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] snapshot_file for this snap is: volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c9a432-4525-44c9-ad0f-a29922ecf059]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:50 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 Sep 25 13:39:50 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:50 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45746499-2081-4dd9-b17f-b6160b1e54ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6d98a-f163-402a-a964-378c42e089ba]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:50 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab Sep 25 13:39:50 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:50 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab" returned: 0 in 0.470s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:51 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 Sep 25 13:39:51 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Flow 'volume_create_manager' (a0354909-0f78-4ef8-8538-b555574a4ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbd001a-2e66-4268-90ff-aec766c2364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbd001a-2e66-4268-90ff-aec766c2364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577779764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffad4926-4e49-4fa5-9ea2-269a7cbfa522,host='devstack@QuobyteHD#QuobyteHD',id=d413497b-bda6-46b2-bd65-c6d094db298c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b674c5647d45bf911ab57b938a00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:51Z,use_quota=True,user_id='2e98e2ec97e243e0b5f42f7db155b913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df15243-037e-4470-ae20-6089f0ec0dd7),volume_type_id=5df15243-037e-4470-ae20-6089f0ec0dd7)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b328f991-0039-46fe-8e59-bbdea36f2d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b328f991-0039-46fe-8e59-bbdea36f2d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48740a3e-bb10-4f70-8149-8a2eec6e0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48740a3e-bb10-4f70-8149-8a2eec6e0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd413497b-bda6-46b2-bd65-c6d094db298c', 'volume_name': 'volume-d413497b-bda6-46b2-bd65-c6d094db298c', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2838a586-51fc-4030-8616-8b5727385436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2838a586-51fc-4030-8616-8b5727385436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a69fc4c-6cde-484f-aa39-9066d1ffcea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Volume d413497b-bda6-46b2-bd65-c6d094db298c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d413497b-bda6-46b2-bd65-c6d094db298c', 'volume_size': 1} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ffad4926-4e49-4fa5-9ea2-269a7cbfa522,created_at=2026-09-25T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577779764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffad4926-4e49-4fa5-9ea2-269a7cbfa522,host='devstack@QuobyteHD#QuobyteHD',id=d413497b-bda6-46b2-bd65-c6d094db298c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b674c5647d45bf911ab57b938a00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:51Z,use_quota=True,user_id='2e98e2ec97e243e0b5f42f7db155b913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df15243-037e-4470-ae20-6089f0ec0dd7),volume_type_id=5df15243-037e-4470-ae20-6089f0ec0dd7)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Creating volume d413497b-bda6-46b2-bd65-c6d094db298c {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:39:51 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:51 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c 1073741824 Sep 25 13:39:51 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:51 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869" returned: 0 in 0.749s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:51 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869 Sep 25 13:39:51 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:52 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab.dcbec3ae-9914-408a-aa03-6ec8e903a869" returned: 0 in 0.368s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-quobyte-dcbec3ae-9914-408a-aa03-6ec8e903a869" released by "_delete_snapshot" :: held 2.211s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-quobyte-45746499-2081-4dd9-b17f-b6160b1e54ab" released by "delete_snapshot" :: held 2.271s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:52 devstack cinder-volume[87220]: WARNING cinder.quota [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.quota [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Created reservations ['717f07ae-bb33-4802-91b0-c4bc5e057c0f', '8a288fee-54e4-4ddb-89c6-ec9b6cbf96ee', 'ff6c6037-9883-45c0-a9e7-7fda0e84a84e', '07cfefcf-5a12-4c8d-9a6a-201b1f14a008'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:52 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c 1073741824" returned: 0 in 0.739s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Delete snapshot completed successfully. Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-16c32fbd-09f8-4086-b382-1094e49e5ddb req-473dc915-72e0-4956-86ea-762342348041 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-dcbec3ae-9914-408a-aa03-6ec8e903a869-delete_snapshot" released by "delete_snapshot" :: held 2.552s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:52 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c Sep 25 13:39:52 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:52 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c" returned: 0 in 0.374s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a69fc4c-6cde-484f-aa39-9066d1ffcea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d413497b-bda6-46b2-bd65-c6d094db298c', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdd438d-cf52-4607-887f-c568c0b6db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:52 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Volume volume-d413497b-bda6-46b2-bd65-c6d094db298c (d413497b-bda6-46b2-bd65-c6d094db298c): created successfully Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdd438d-cf52-4607-887f-c568c0b6db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Flow 'volume_create_manager' (a0354909-0f78-4ef8-8538-b555574a4ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-26369ff5-0151-4104-a7f1-50844cee1074 tempest-GroupsTest-464726452 None] Created volume successfully. Sep 25 13:39:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "cinder-45746499-2081-4dd9-b17f-b6160b1e54ab-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-45746499-2081-4dd9-b17f-b6160b1e54ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "cinder-quobyte-45746499-2081-4dd9-b17f-b6160b1e54ab" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-quobyte-45746499-2081-4dd9-b17f-b6160b1e54ab" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa5e825-32c9-46aa-be86-437db5595d61]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:53 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab Sep 25 13:39:53 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:54 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab" returned: 0 in 0.622s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:54 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab Sep 25 13:39:54 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:54 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-45746499-2081-4dd9-b17f-b6160b1e54ab" returned: 0 in 0.658s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Flow 'volume_create_manager' (ee10fb2e-d2b9-4cf7-9221-67f899f0a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a49935-f799-4649-b5d3-db28dae4f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-quobyte-45746499-2081-4dd9-b17f-b6160b1e54ab" released by "delete_volume" :: held 1.418s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a49935-f799-4649-b5d3-db28dae4f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2031142706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9899f01a-d018-413d-abdf-3f070ef45984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68737eb2e4e4777a52294992700c4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:55Z,use_quota=True,user_id='0d2f5faaf02943acab4df128a494241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4999c07-3532-46ba-ab7c-770ffb1d5dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4999c07-3532-46ba-ab7c-770ffb1d5dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe431d56-8d95-4b9c-9404-f22ce7c10d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:54 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Acquiring lock "cinder-quobyte-d413497b-bda6-46b2-bd65-c6d094db298c" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.quota [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Created reservations ['511cd6dd-2ec7-4630-827a-0d067a834df4', 'ce826741-da9b-4dde-8982-81516df75b86', '6379129f-be01-4f5c-90b4-876bd61a9037', 'f22ee275-6d85-42bf-9e2a-5ac4afeadd10'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Lock "cinder-quobyte-d413497b-bda6-46b2-bd65-c6d094db298c" acquired by "delete_volume" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc6fae4-ae2a-4791-b06c-f1cfeebac5e5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:55 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c Sep 25 13:39:55 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:55 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:39:55 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe431d56-8d95-4b9c-9404-f22ce7c10d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9899f01a-d018-413d-abdf-3f070ef45984', 'volume_name': 'volume-9899f01a-d018-413d-abdf-3f070ef45984', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d31a33-a024-49dc-ad8f-4d38edd58da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d31a33-a024-49dc-ad8f-4d38edd58da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab889042-44ee-415b-b81a-48f8e2fee56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:39:55 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Volume 9899f01a-d018-413d-abdf-3f070ef45984: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9899f01a-d018-413d-abdf-3f070ef45984', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Trying to clone 9899f01a-d018-413d-abdf-3f070ef45984 from image a1a28988-676d-4ae6-a228-f7c326723a56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:39:55 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c" returned: 0 in 0.612s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:55 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c Sep 25 13:39:55 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:55 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.533s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.manager [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:39:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Deleted volume successfully. Sep 25 13:39:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-9886f56b-2ea5-44d3-b536-500f3558f364 req-2a8ed7aa-c4b3-4905-8a63-554b834c72b3 tempest-VolumesSnapshotsTestJSON-548013941 None] Lock "cinder-45746499-2081-4dd9-b17f-b6160b1e54ab-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:39:56 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Image download 20.69 MB at 20.69 MB/s Sep 25 13:39:56 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d413497b-bda6-46b2-bd65-c6d094db298c" returned: 0 in 0.544s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Lock "cinder-quobyte-d413497b-bda6-46b2-bd65-c6d094db298c" released by "delete_volume" :: held 1.241s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab0545-39f8-419c-b89c-35d388222b60]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Created reservations ['868c3d62-d640-4082-89d1-e5f4dc44be99'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:56 devstack cinder-volume[87220]: WARNING cinder.quota [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1297418819 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1297418819, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:39:56 devstack cinder-volume[87220]: WARNING cinder.quota [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1297418819 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1297418819, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:39:56 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD Sep 25 13:39:56 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Created reservations ['f663d613-12ba-4a51-9888-21c6612af7c1', 'd877dc32-4f21-4648-975a-507c538f325d', 'ab1ab059-3dc5-43b1-bea5-0fb255ed53f2', '79ed3050-3947-4400-bb22-341a8795f5b8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:56 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:39:56 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:56 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 is fetched for user 0d2f5faaf02943acab4df128a494241e. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[516cf2c1-119d-4cf2-b26e-efb314a4a9b3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:57 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:39:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fb5530c2-6e67-4a0a-b6d0-ce6c3e0d7962 tempest-GroupsTest-464726452 None] Delete group completed successfully. Sep 25 13:39:57 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD Sep 25 13:39:57 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:57 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2031142706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9899f01a-d018-413d-abdf-3f070ef45984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68737eb2e4e4777a52294992700c4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:39:55Z,use_quota=True,user_id='0d2f5faaf02943acab4df128a494241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Creating volume 9899f01a-d018-413d-abdf-3f070ef45984 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:39:57 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:57 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 1073741824 Sep 25 13:39:57 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Created reservations ['a78b518e-b86d-4052-95c4-8383b95f7bd9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:57 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:39:57 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:58 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 1073741824" returned: 0 in 0.707s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:58 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.364s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:39:58 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 Sep 25 13:39:58 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fcfa701f-0e59-4925-af35-71441f427ef3 tempest-GroupsTest-464726452 None] Delete group completed successfully. Sep 25 13:39:58 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984" returned: 0 in 0.526s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:39:58 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Attempting download of a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume 9899f01a-d018-413d-abdf-3f070ef45984. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:39:59 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7559f332-1ce7-49d2-a7f5-d03478ca2ea1]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:39:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:39:59 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl Sep 25 13:39:59 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:39:59 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Sep 25 13:39:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl" returned: 0 in 0.684s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:39:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:00 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl Sep 25 13:40:00 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:00 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl" returned: 1 in 0.943s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_8xbm5nfl' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:40:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a00c197-8cf6-445d-a2ef-a4474666ee8a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e50e41ff-4309-49a5-87c6-8717eabd475f tempest-GroupsTest-464726452 None] Group tempest-GroupsTest-Group-968434007: creating Sep 25 13:40:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e50e41ff-4309-49a5-87c6-8717eabd475f tempest-GroupsTest-464726452 None] Group tempest-GroupsTest-Group-968434007: created successfully Sep 25 13:40:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e50e41ff-4309-49a5-87c6-8717eabd475f tempest-GroupsTest-464726452 None] Create group completed successfully. Sep 25 13:40:00 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD Sep 25 13:40:00 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:01 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD" returned: 0 in 0.581s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:01 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] a1a28988-676d-4ae6-a228-f7c326723a56 was qcow2, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:40:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:01 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 Sep 25 13:40:01 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Flow 'volume_create_manager' (1a5dfde4-bdf4-44ec-93f6-39786b9793ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0487b3-2cf1-4da4-8645-dcb8679a021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0487b3-2cf1-4da4-8645-dcb8679a021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-997417184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8e9f854-6f1a-4931-9d19-12f941218c2a,host='devstack@QuobyteHD#QuobyteHD',id=0291e676-c373-4648-a1c7-f6253329ac0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b674c5647d45bf911ab57b938a00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:03Z,use_quota=True,user_id='2e98e2ec97e243e0b5f42f7db155b913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(450428f9-def3-4129-89a5-1a3e980081b6),volume_type_id=450428f9-def3-4129-89a5-1a3e980081b6)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ec31e7-bd46-4d7d-99f1-e5140c694f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ec31e7-bd46-4d7d-99f1-e5140c694f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61940c8b-cc06-4b4f-a6bd-d1c6a82be576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61940c8b-cc06-4b4f-a6bd-d1c6a82be576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0291e676-c373-4648-a1c7-f6253329ac0a', 'volume_name': 'volume-0291e676-c373-4648-a1c7-f6253329ac0a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ade3777-07ec-4405-a670-2b326bdf1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ade3777-07ec-4405-a670-2b326bdf1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767140fc-744e-4f36-9590-c154d08abc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Volume 0291e676-c373-4648-a1c7-f6253329ac0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0291e676-c373-4648-a1c7-f6253329ac0a', 'volume_size': 1} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d8e9f854-6f1a-4931-9d19-12f941218c2a,created_at=2026-09-25T11:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-997417184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8e9f854-6f1a-4931-9d19-12f941218c2a,host='devstack@QuobyteHD#QuobyteHD',id=0291e676-c373-4648-a1c7-f6253329ac0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b674c5647d45bf911ab57b938a00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:03Z,use_quota=True,user_id='2e98e2ec97e243e0b5f42f7db155b913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(450428f9-def3-4129-89a5-1a3e980081b6),volume_type_id=450428f9-def3-4129-89a5-1a3e980081b6)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Creating volume 0291e676-c373-4648-a1c7-f6253329ac0a {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:03 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:03 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a 1073741824 Sep 25 13:40:03 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Flow 'volume_create_manager' (0227d6a5-139a-4c8c-a66e-218b966253bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fea2eb7-003a-4f62-9dc2-17e8809847d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fea2eb7-003a-4f62-9dc2-17e8809847d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-413949366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4222c698-e1a0-49df-9f1a-f4543b9f9b89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c73e3a52942146c4a874f729bc43ef57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:04Z,use_quota=True,user_id='59f03ee600014e0d9e0019b598484746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673769f7-25ce-4339-9e0e-367be0186c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673769f7-25ce-4339-9e0e-367be0186c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6107e7-f4ab-4ebe-b1a0-eaf7dc2ea100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6107e7-f4ab-4ebe-b1a0-eaf7dc2ea100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4222c698-e1a0-49df-9f1a-f4543b9f9b89', 'volume_name': 'volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c2901-6719-4ee2-ae2d-85760d4cb012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c2901-6719-4ee2-ae2d-85760d4cb012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d11e83e-0161-4bc0-babd-35aca07efd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Volume 4222c698-e1a0-49df-9f1a-f4543b9f9b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89', 'volume_size': 1} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:03 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a 1073741824" returned: 0 in 0.790s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:03 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a Sep 25 13:40:03 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:04 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a" returned: 0 in 0.393s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-413949366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4222c698-e1a0-49df-9f1a-f4543b9f9b89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c73e3a52942146c4a874f729bc43ef57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:04Z,use_quota=True,user_id='59f03ee600014e0d9e0019b598484746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Creating volume 4222c698-e1a0-49df-9f1a-f4543b9f9b89 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:04 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767140fc-744e-4f36-9590-c154d08abc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0291e676-c373-4648-a1c7-f6253329ac0a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1937213e-47bf-45f1-8494-4ca319ec4197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:04 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 1073741824 Sep 25 13:40:04 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:04 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Volume volume-0291e676-c373-4648-a1c7-f6253329ac0a (0291e676-c373-4648-a1c7-f6253329ac0a): created successfully Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1937213e-47bf-45f1-8494-4ca319ec4197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Flow 'volume_create_manager' (1a5dfde4-bdf4-44ec-93f6-39786b9793ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0d474098-7596-4dd4-b35b-d5a42cbcef6f tempest-GroupsTest-464726452 None] Created volume successfully. Sep 25 13:40:04 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984" returned: 0 in 3.380s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_u9m5hzg9devstack@QuobyteHD, size 112.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:40:04 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Converted 112.00 MB image at 33.11 MB/s Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:04 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 1G Sep 25 13:40:04 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:04 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 1073741824" returned: 0 in 0.687s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:05 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 Sep 25 13:40:05 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:05 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 1G" returned: 0 in 0.545s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Downloaded image a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume 9899f01a-d018-413d-abdf-3f070ef45984 successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 for user 0d2f5faaf02943acab4df128a494241e is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Marking volume 9899f01a-d018-413d-abdf-3f070ef45984 as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Copying metadata from image a1a28988-676d-4ae6-a228-f7c326723a56 to 9899f01a-d018-413d-abdf-3f070ef45984. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Creating volume glance metadata for volume 9899f01a-d018-413d-abdf-3f070ef45984 backed by image a1a28988-676d-4ae6-a228-f7c326723a56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab889042-44ee-415b-b81a-48f8e2fee56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9899f01a-d018-413d-abdf-3f070ef45984', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fed222-1e63-4623-8c8a-80cee4c5cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:05 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Volume volume-9899f01a-d018-413d-abdf-3f070ef45984 (9899f01a-d018-413d-abdf-3f070ef45984): created successfully Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fed222-1e63-4623-8c8a-80cee4c5cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Flow 'volume_create_manager' (ee10fb2e-d2b9-4cf7-9221-67f899f0a337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89" returned: 0 in 0.437s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d11e83e-0161-4bc0-babd-35aca07efd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b458e0cf-b827-4fb3-8000-267aaa9199f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0dde20f3-45e5-451a-b46e-f75967463ee1 tempest-ServerActionsTestOtherA-1622259837 None] Created volume successfully. Sep 25 13:40:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Volume volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 (4222c698-e1a0-49df-9f1a-f4543b9f9b89): created successfully Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b458e0cf-b827-4fb3-8000-267aaa9199f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Flow 'volume_create_manager' (0227d6a5-139a-4c8c-a66e-218b966253bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5d7e69b4-06c3-480a-a7d5-206ab4db9f5e tempest-VolumesTestJSON-568148426 None] Created volume successfully. Sep 25 13:40:06 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Flow 'volume_create_manager' (55543a78-15fd-48e6-ba51-df4049e9fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa227e2-000d-45a6-9e10-176fe7311201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa227e2-000d-45a6-9e10-176fe7311201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398052601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8e9f854-6f1a-4931-9d19-12f941218c2a,host='devstack@QuobyteHD#QuobyteHD',id=3351a612-75b4-4b30-a6a8-3d4f96723fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b674c5647d45bf911ab57b938a00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:07Z,use_quota=True,user_id='2e98e2ec97e243e0b5f42f7db155b913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(450428f9-def3-4129-89a5-1a3e980081b6),volume_type_id=450428f9-def3-4129-89a5-1a3e980081b6)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd8962e-4f1a-449f-8d3a-ad9360b9a2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd8962e-4f1a-449f-8d3a-ad9360b9a2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde213b-bd23-4cc9-a9b6-f4a8dbb7600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde213b-bd23-4cc9-a9b6-f4a8dbb7600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3351a612-75b4-4b30-a6a8-3d4f96723fbb', 'volume_name': 'volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e35a55-7811-4994-9ff7-a31056e57654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e35a55-7811-4994-9ff7-a31056e57654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a14ff9-439e-42a4-bf05-2ef261103bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Volume 3351a612-75b4-4b30-a6a8-3d4f96723fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb', 'volume_size': 1} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d8e9f854-6f1a-4931-9d19-12f941218c2a,created_at=2026-09-25T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398052601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8e9f854-6f1a-4931-9d19-12f941218c2a,host='devstack@QuobyteHD#QuobyteHD',id=3351a612-75b4-4b30-a6a8-3d4f96723fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b674c5647d45bf911ab57b938a00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:07Z,use_quota=True,user_id='2e98e2ec97e243e0b5f42f7db155b913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(450428f9-def3-4129-89a5-1a3e980081b6),volume_type_id=450428f9-def3-4129-89a5-1a3e980081b6)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Creating volume 3351a612-75b4-4b30-a6a8-3d4f96723fbb {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:07 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:07 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb 1073741824 Sep 25 13:40:07 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Flow 'volume_create_manager' (6726080f-e608-40a9-b176-504d6a67305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789f1e4b-c85f-4acc-84c5-7bd775af5a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789f1e4b-c85f-4acc-84c5-7bd775af5a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1323923085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b96f91-f7d1-4407-bcf4-370dceb55e2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c73e3a52942146c4a874f729bc43ef57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:07Z,use_quota=True,user_id='59f03ee600014e0d9e0019b598484746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66354fc2-a3ad-47ae-8170-0eb208093791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66354fc2-a3ad-47ae-8170-0eb208093791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172cc997-2556-4fde-9a2c-52d9fa22dc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172cc997-2556-4fde-9a2c-52d9fa22dc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b96f91-f7d1-4407-bcf4-370dceb55e2d', 'volume_name': 'volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7892ad1a-fe7a-4b21-bb1d-88036154bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7892ad1a-fe7a-4b21-bb1d-88036154bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b9d03b-d204-4030-9a58-508cb76c635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Volume 11b96f91-f7d1-4407-bcf4-370dceb55e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d', 'volume_size': 1} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:07 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb 1073741824" returned: 0 in 0.670s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:07 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb Sep 25 13:40:07 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:08 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1323923085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b96f91-f7d1-4407-bcf4-370dceb55e2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c73e3a52942146c4a874f729bc43ef57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:07Z,use_quota=True,user_id='59f03ee600014e0d9e0019b598484746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Creating volume 11b96f91-f7d1-4407-bcf4-370dceb55e2d {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:08 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a14ff9-439e-42a4-bf05-2ef261103bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867ceaab-3392-4e6b-9b8f-6ef2712daed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:08 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d 1073741824 Sep 25 13:40:08 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Volume volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb (3351a612-75b4-4b30-a6a8-3d4f96723fbb): created successfully Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867ceaab-3392-4e6b-9b8f-6ef2712daed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Flow 'volume_create_manager' (55543a78-15fd-48e6-ba51-df4049e9fe09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:08 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c24ad845-ccb0-4884-aeb6-263257eaacdf tempest-GroupsTest-464726452 None] Created volume successfully. Sep 25 13:40:08 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d 1073741824" returned: 0 in 0.672s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:09 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d Sep 25 13:40:09 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:09 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d" returned: 0 in 0.390s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b9d03b-d204-4030-9a58-508cb76c635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258252c5-fe4c-4c1f-8125-6863230fb15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:09 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Volume volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d (11b96f91-f7d1-4407-bcf4-370dceb55e2d): created successfully Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258252c5-fe4c-4c1f-8125-6863230fb15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Flow 'volume_create_manager' (6726080f-e608-40a9-b176-504d6a67305d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0386fe56-45bd-4a46-bf54-93493da9a7b2 tempest-VolumesTestJSON-568148426 None] Created volume successfully. Sep 25 13:40:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c82ef154-a9b0-41f4-920f-347d2eaff6db tempest-GroupsTest-464726452 None] Update group completed successfully. Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:09 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:09 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:10 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.459s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-720a405b-1c9c-429c-9443-337f9c93c03a req-dfa2fa97-2499-4fb6-9ae3-af97e1073323 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-720a405b-1c9c-429c-9443-337f9c93c03a req-dfa2fa97-2499-4fb6-9ae3-af97e1073323 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-720a405b-1c9c-429c-9443-337f9c93c03a req-dfa2fa97-2499-4fb6-9ae3-af97e1073323 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-720a405b-1c9c-429c-9443-337f9c93c03a req-dfa2fa97-2499-4fb6-9ae3-af97e1073323 tempest-ServerActionsTestOtherA-1622259837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-9899f01a-d018-413d-abdf-3f070ef45984', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c00d995-8dea-4570-96f5-82a503748056', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:40:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-720a405b-1c9c-429c-9443-337f9c93c03a req-dfa2fa97-2499-4fb6-9ae3-af97e1073323 tempest-ServerActionsTestOtherA-1622259837 None] attachment_update completed successfully. Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Flow 'volume_create_manager' (57d7fcf4-3ac1-4251-a452-8799ba164f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040260b8-23ab-42a7-8401-eff73ce824bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040260b8-23ab-42a7-8401-eff73ce824bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321044234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7135c33f-f9cd-4bcf-a252-f1a71f540b6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c73e3a52942146c4a874f729bc43ef57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:11Z,use_quota=True,user_id='59f03ee600014e0d9e0019b598484746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471613d6-4d8f-4d10-a3fc-755bef89169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471613d6-4d8f-4d10-a3fc-755bef89169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32f830d-56c2-4a68-bcc6-ad6cb21ab95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32f830d-56c2-4a68-bcc6-ad6cb21ab95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7135c33f-f9cd-4bcf-a252-f1a71f540b6b', 'volume_name': 'volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a0b6d5-6c21-4eb6-9e48-0b58496a68a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a0b6d5-6c21-4eb6-9e48-0b58496a68a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3c973a-e132-48c5-a4b5-12cc38357ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Volume 7135c33f-f9cd-4bcf-a252-f1a71f540b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b', 'volume_size': 1} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321044234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7135c33f-f9cd-4bcf-a252-f1a71f540b6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c73e3a52942146c4a874f729bc43ef57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:11Z,use_quota=True,user_id='59f03ee600014e0d9e0019b598484746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Creating volume 7135c33f-f9cd-4bcf-a252-f1a71f540b6b {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:11 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:11 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b 1073741824 Sep 25 13:40:11 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:11 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ad94d36b-3e7e-44b8-b8a4-6418c8997653 tempest-GroupsTest-464726452 None] Update group completed successfully. Sep 25 13:40:12 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b 1073741824" returned: 0 in 0.658s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:12 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b Sep 25 13:40:12 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:12 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3c973a-e132-48c5-a4b5-12cc38357ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b1225a-cd10-4620-a348-fc8f91b18da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Volume volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b (7135c33f-f9cd-4bcf-a252-f1a71f540b6b): created successfully Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b1225a-cd10-4620-a348-fc8f91b18da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Flow 'volume_create_manager' (57d7fcf4-3ac1-4251-a452-8799ba164f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a2b4a5cd-1fc3-4cca-9e3a-6472555ef3a4 tempest-VolumesTestJSON-568148426 None] Created volume successfully. Sep 25 13:40:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Acquiring lock "cinder-quobyte-0291e676-c373-4648-a1c7-f6253329ac0a" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Lock "cinder-quobyte-0291e676-c373-4648-a1c7-f6253329ac0a" acquired by "delete_volume" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:13 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[db49a2fc-6da6-456e-b1f8-0867e9664b1e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:13 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a Sep 25 13:40:13 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:14 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a" returned: 0 in 0.635s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:14 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a Sep 25 13:40:14 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Acquiring lock "cinder-7135c33f-f9cd-4bcf-a252-f1a71f540b6b-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:14 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Lock "cinder-7135c33f-f9cd-4bcf-a252-f1a71f540b6b-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0291e676-c373-4648-a1c7-f6253329ac0a" returned: 0 in 0.629s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Lock "cinder-quobyte-0291e676-c373-4648-a1c7-f6253329ac0a" released by "delete_volume" :: held 1.419s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Acquiring lock "cinder-quobyte-3351a612-75b4-4b30-a6a8-3d4f96723fbb" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Lock "cinder-quobyte-3351a612-75b4-4b30-a6a8-3d4f96723fbb" acquired by "delete_volume" :: waited 0.049s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[09400539-9735-4fe0-9179-7cc5bb509314]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Acquiring lock "cinder-quobyte-7135c33f-f9cd-4bcf-a252-f1a71f540b6b" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Lock "cinder-quobyte-7135c33f-f9cd-4bcf-a252-f1a71f540b6b" acquired by "delete_volume" :: waited 0.058s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a17424-7f37-4850-ac74-aad114d38dec]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:15 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb Sep 25 13:40:15 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:15 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b Sep 25 13:40:15 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:16 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb" returned: 0 in 1.010s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:16 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb Sep 25 13:40:16 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:16 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b" returned: 0 in 0.974s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:16 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b Sep 25 13:40:16 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:16 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3351a612-75b4-4b30-a6a8-3d4f96723fbb" returned: 0 in 0.409s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Lock "cinder-quobyte-3351a612-75b4-4b30-a6a8-3d4f96723fbb" released by "delete_volume" :: held 1.518s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:16 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7135c33f-f9cd-4bcf-a252-f1a71f540b6b" returned: 0 in 0.404s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Lock "cinder-quobyte-7135c33f-f9cd-4bcf-a252-f1a71f540b6b" released by "delete_volume" :: held 1.477s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Created reservations ['9dd3c55d-376b-4456-b310-337223f5d0cc'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Created reservations ['ef2ed75c-d335-4eba-8d58-3d3f8974a903', 'fbc444e4-b6cd-4e08-a88d-d41847319ac1', '058119a3-2324-49d9-a8a0-25144a4b7f90', '7fe1d8dd-1615-471a-8067-f423978a9a84'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:16 devstack cinder-volume[87220]: WARNING cinder.quota [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1648880806 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1648880806, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:40:16 devstack cinder-volume[87220]: WARNING cinder.quota [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1648880806 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1648880806, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Created reservations ['e5cbcb41-7452-4359-89d3-8cd9e6a627dd', 'ccef4dd6-3786-4bb3-9bb3-59eceeb41a3c', '9db39d86-6e4c-44f5-a661-d108f48dae2d', 'ebccfd16-d0a9-42dc-acf2-1c4540745d3c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:16 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:16 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Created reservations ['fdf25fbb-c7fa-46a1-aaff-5222dd850be0', '576294c1-f072-42a6-845f-a94f0fb414a4', '2604eab3-61df-4a1b-bb4d-74db658bc0ed', 'ed3bf861-69e7-406a-89c1-d4bdf571fd6d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Acquiring lock "cinder-11b96f91-f7d1-4407-bcf4-370dceb55e2d-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Lock "cinder-11b96f91-f7d1-4407-bcf4-370dceb55e2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:17 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:17 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Acquiring lock "cinder-quobyte-11b96f91-f7d1-4407-bcf4-370dceb55e2d" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Lock "cinder-quobyte-11b96f91-f7d1-4407-bcf4-370dceb55e2d" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:17 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.397s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Deleted volume successfully. Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a69ce7-3f66-4301-b0b0-0a2d439a326e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6112841-0251-4d39-b3bf-c3936a086748 tempest-VolumesTestJSON-568148426 None] Lock "cinder-7135c33f-f9cd-4bcf-a252-f1a71f540b6b-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:17 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d Sep 25 13:40:17 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:17 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.327s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1ec1d836-7a96-4e91-aa91-9fc7d0aa3869 tempest-GroupsTest-464726452 None] Delete group completed successfully. Sep 25 13:40:17 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d" returned: 0 in 0.531s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:17 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d Sep 25 13:40:17 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:18 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-11b96f91-f7d1-4407-bcf4-370dceb55e2d" returned: 0 in 0.327s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Lock "cinder-quobyte-11b96f91-f7d1-4407-bcf4-370dceb55e2d" released by "delete_volume" :: held 0.932s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Created reservations ['bfd33968-c206-4256-98cb-65614607c941', 'e2ca6914-e2df-4577-87cb-7e957a3fbd06', 'e51fb73e-6517-49c6-b638-0e4f4b6daf31', '32b8dcb3-5bcb-4c7f-833a-cbea2ab77000'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:18 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:18 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:18 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Deleted volume successfully. Sep 25 13:40:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f4a9a6ee-1382-411a-9836-e353cc567afd tempest-VolumesTestJSON-568148426 None] Lock "cinder-11b96f91-f7d1-4407-bcf4-370dceb55e2d-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Acquiring lock "cinder-4222c698-e1a0-49df-9f1a-f4543b9f9b89-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Lock "cinder-4222c698-e1a0-49df-9f1a-f4543b9f9b89-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Acquiring lock "cinder-quobyte-4222c698-e1a0-49df-9f1a-f4543b9f9b89" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Lock "cinder-quobyte-4222c698-e1a0-49df-9f1a-f4543b9f9b89" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66c161-3afa-4939-973f-ddda3eae39a5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:19 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 Sep 25 13:40:19 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:20 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89" returned: 0 in 0.632s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:20 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89 Sep 25 13:40:20 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:20 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4222c698-e1a0-49df-9f1a-f4543b9f9b89" returned: 0 in 0.450s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Lock "cinder-quobyte-4222c698-e1a0-49df-9f1a-f4543b9f9b89" released by "delete_volume" :: held 1.164s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Created reservations ['e125a6d9-39d1-4d40-9af7-b2212ff9fc62', '63b71fed-0cc7-4415-92e7-0be3573769d1', '33f73d79-798e-4bc0-a8c3-b0d170463fa1', 'c29fd22f-a76e-4def-a4f4-f076c9056467'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:21 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:21 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:21 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.501s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Deleted volume successfully. Sep 25 13:40:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9adf23fc-d867-4f53-b849-c967f01cfa71 tempest-VolumesTestJSON-568148426 None] Lock "cinder-4222c698-e1a0-49df-9f1a-f4543b9f9b89-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Flow 'volume_create_manager' (ba24d8ee-2bff-45f3-bc6f-59f945d50476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1606ed4c-46d8-4e73-9514-7645af412509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1606ed4c-46d8-4e73-9514-7645af412509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1108443164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a1c593-02cd-4bff-8e6b-af6cc5368565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbf75c1175d46a1814421605a86bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:27Z,use_quota=True,user_id='124a8d209f8e4ab8a41656c92c5fdc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a4dccd-744c-48f5-8d14-f11009f2bb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a4dccd-744c-48f5-8d14-f11009f2bb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f259ae0-cbdb-4bf5-9889-5013d66545dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f259ae0-cbdb-4bf5-9889-5013d66545dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a1c593-02cd-4bff-8e6b-af6cc5368565', 'volume_name': 'volume-14a1c593-02cd-4bff-8e6b-af6cc5368565', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cdc9c7-00eb-46a3-a037-7737aaa392dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cdc9c7-00eb-46a3-a037-7737aaa392dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc9cf8c-1a1d-4400-bdd9-7ad87af6a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:27 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Volume 14a1c593-02cd-4bff-8e6b-af6cc5368565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a1c593-02cd-4bff-8e6b-af6cc5368565', 'volume_size': 1} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1108443164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a1c593-02cd-4bff-8e6b-af6cc5368565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbf75c1175d46a1814421605a86bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:27Z,use_quota=True,user_id='124a8d209f8e4ab8a41656c92c5fdc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Creating volume 14a1c593-02cd-4bff-8e6b-af6cc5368565 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:27 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:27 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 1073741824 Sep 25 13:40:27 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:28 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 1073741824" returned: 0 in 0.663s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:28 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 Sep 25 13:40:28 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:28 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc9cf8c-1a1d-4400-bdd9-7ad87af6a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a1c593-02cd-4bff-8e6b-af6cc5368565', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f946548f-e3cf-4c7e-9c3a-627dc6da7816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Volume volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 (14a1c593-02cd-4bff-8e6b-af6cc5368565): created successfully Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f946548f-e3cf-4c7e-9c3a-627dc6da7816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Flow 'volume_create_manager' (ba24d8ee-2bff-45f3-bc6f-59f945d50476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e0b248ad-0a6f-4fe5-b41e-fd97a78e0928 tempest-AttachVolumeNegativeTest-767953356 None] Created volume successfully. Sep 25 13:40:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f4b2a1e1-468c-4cb6-b30a-ce7ed1010f90 tempest-GroupsV314Test-1482146879 None] Group tempest-GroupsV314Test-Group-1414725645: creating Sep 25 13:40:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f4b2a1e1-468c-4cb6-b30a-ce7ed1010f90 tempest-GroupsV314Test-1482146879 None] Group tempest-GroupsV314Test-Group-1414725645: created successfully Sep 25 13:40:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f4b2a1e1-468c-4cb6-b30a-ce7ed1010f90 tempest-GroupsV314Test-1482146879 None] Create group completed successfully. Sep 25 13:40:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-7587889e-5a86-4fd6-86a0-c5fe060a0cff req-32b4ec3a-8469-4d71-b8eb-abb9c667f007 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-7587889e-5a86-4fd6-86a0-c5fe060a0cff req-32b4ec3a-8469-4d71-b8eb-abb9c667f007 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-7587889e-5a86-4fd6-86a0-c5fe060a0cff req-32b4ec3a-8469-4d71-b8eb-abb9c667f007 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-7587889e-5a86-4fd6-86a0-c5fe060a0cff req-32b4ec3a-8469-4d71-b8eb-abb9c667f007 tempest-AttachVolumeNegativeTest-767953356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-14a1c593-02cd-4bff-8e6b-af6cc5368565', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '343533f0-05cd-4343-ba2e-d47199e822be', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:40:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-7587889e-5a86-4fd6-86a0-c5fe060a0cff req-32b4ec3a-8469-4d71-b8eb-abb9c667f007 tempest-AttachVolumeNegativeTest-767953356 None] attachment_update completed successfully. Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Flow 'volume_create_manager' (743abbeb-10d4-425d-aa20-d4e1f3cd8e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458c9487-b3c6-4ced-b4fd-d5c8598ecf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458c9487-b3c6-4ced-b4fd-d5c8598ecf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015268744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5aeeea46-afb1-46a6-bd9c-6ddf01a717e0,host='devstack@QuobyteHD#QuobyteHD',id=4d23e65b-9c5b-4a2b-b315-e186004d17cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6999cf81e8e648d4952c48d6f40de1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:33Z,use_quota=True,user_id='bc73cbddb8054dbc94d6e29f746f1f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3b85f88-824b-47c7-a292-8d218e8869de),volume_type_id=b3b85f88-824b-47c7-a292-8d218e8869de)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d4125f-3db5-4310-a07f-726605082c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d4125f-3db5-4310-a07f-726605082c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0b717a-ed94-4ea9-90ac-f16bcccea654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0b717a-ed94-4ea9-90ac-f16bcccea654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d23e65b-9c5b-4a2b-b315-e186004d17cd', 'volume_name': 'volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290017e6-e01a-4861-9e33-704f3aea8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290017e6-e01a-4861-9e33-704f3aea8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde3b421-2e6d-4d98-8820-4e271f8a466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Volume 4d23e65b-9c5b-4a2b-b315-e186004d17cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd', 'volume_size': 1} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5aeeea46-afb1-46a6-bd9c-6ddf01a717e0,created_at=2026-09-25T11:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015268744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5aeeea46-afb1-46a6-bd9c-6ddf01a717e0,host='devstack@QuobyteHD#QuobyteHD',id=4d23e65b-9c5b-4a2b-b315-e186004d17cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6999cf81e8e648d4952c48d6f40de1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:33Z,use_quota=True,user_id='bc73cbddb8054dbc94d6e29f746f1f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3b85f88-824b-47c7-a292-8d218e8869de),volume_type_id=b3b85f88-824b-47c7-a292-8d218e8869de)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Creating volume 4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:32 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:32 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd 1073741824 Sep 25 13:40:32 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:33 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd 1073741824" returned: 0 in 0.886s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:33 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd Sep 25 13:40:33 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-7d6704bf-1b88-4816-b4c4-8b049086aa6d tempest-ServerActionsTestOtherA-1622259837 None] Terminate volume connection completed successfully. Sep 25 13:40:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-7d6704bf-1b88-4816-b4c4-8b049086aa6d tempest-ServerActionsTestOtherA-1622259837 None] Deleting attachment 8c00d995-8dea-4570-96f5-82a503748056. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:40:34 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd" returned: 0 in 0.396s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde3b421-2e6d-4d98-8820-4e271f8a466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68af0593-9fb6-4a5a-bd97-a3f1f689b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:34 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Volume volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd (4d23e65b-9c5b-4a2b-b315-e186004d17cd): created successfully Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68af0593-9fb6-4a5a-bd97-a3f1f689b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Flow 'volume_create_manager' (743abbeb-10d4-425d-aa20-d4e1f3cd8e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b55fe0f2-d957-4a05-89e8-7187ed4fe0bb tempest-GroupsV314Test-1482146879 None] Created volume successfully. Sep 25 13:40:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-b400858e-09ef-47ab-8691-c7a27724668a req-f2e91263-7f58-4021-a7a2-996783364a8d tempest-AttachVolumeNegativeTest-767953356 None] Terminate volume connection completed successfully. Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-b400858e-09ef-47ab-8691-c7a27724668a req-f2e91263-7f58-4021-a7a2-996783364a8d tempest-AttachVolumeNegativeTest-767953356 None] Deleting attachment 343533f0-05cd-4343-ba2e-d47199e822be. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:36 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Cloning volume 4d23e65b-9c5b-4a2b-b315-e186004d17cd to volume 119f1909-605d-40c0-a01f-99b5e67507b6 Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-a8aa6e1a-33e4-40e5-aa5c-e6039a3d8343 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Creating offline snapshot fc3a69ad-8d81-471e-b41f-796f64c13eec of volume 4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[712dd0f9-7273-4180-8a6e-8c18b54305c6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:36 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd Sep 25 13:40:36 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:36 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd" returned: 0 in 0.555s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:36 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec 1G Sep 25 13:40:36 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:37 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec 1G" returned: 0 in 0.777s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:37 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec Sep 25 13:40:37 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:38 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec" returned: 0 in 0.465s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:38 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:40:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:38 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec Sep 25 13:40:38 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:38 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec" returned: 0 in 0.298s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:38 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info Sep 25 13:40:38 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:39 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info" returned: 0 in 0.565s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:39 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:39 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info Sep 25 13:40:39 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:39 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.info" returned: 0 in 0.343s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Acquiring lock "cinder-quobyte-119f1909-605d-40c0-a01f-99b5e67507b6" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-119f1909-605d-40c0-a01f-99b5e67507b6" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] snapshot: fc3a69ad-8d81-471e-b41f-796f64c13eec, volume: 119f1909-605d-40c0-a01f-99b5e67507b6, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e1de94-172c-4286-b0e8-b018e5c72d32]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:39 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec Sep 25 13:40:39 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:40 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec" returned: 0 in 0.565s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3770cba-3344-4a43-8204-537d2153ca28]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:40 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd Sep 25 13:40:40 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:40 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd" returned: 0 in 0.677s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:40:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:40 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 Sep 25 13:40:40 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=119,cinder:UPDATE=107,cinder:DELETE=8,cinder:INSERT=32 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=117,cinder:INSERT=29,cinder:SELECT=115,cinder:DELETE=7 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Flow 'volume_create_manager' (6c100eec-894f-414d-aa2d-09ffbe0dd18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4882f6a4-7d3f-4fa3-940c-373fd3b784ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4882f6a4-7d3f-4fa3-940c-373fd3b784ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1883033360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb68f87d-a43b-45ef-a28d-80bb491f982f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9bb850cf184b46af9653bb7a6b87ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:46Z,use_quota=True,user_id='4d0b06c815294be281b382cfcd440604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a04053-2bda-4177-a8e8-ed69ede99bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a04053-2bda-4177-a8e8-ed69ede99bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d91f28-5705-4b90-8829-64a379273da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d91f28-5705-4b90-8829-64a379273da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb68f87d-a43b-45ef-a28d-80bb491f982f', 'volume_name': 'volume-eb68f87d-a43b-45ef-a28d-80bb491f982f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14f5582-3496-46e1-8b57-739fefad19dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14f5582-3496-46e1-8b57-739fefad19dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44c60f2-ba0d-44a6-9876-268a863fbbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Volume eb68f87d-a43b-45ef-a28d-80bb491f982f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb68f87d-a43b-45ef-a28d-80bb491f982f', 'volume_size': 1} Sep 25 13:40:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:49 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6" returned: 0 in 8.877s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:49 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:40:49 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Converted 1024.00 MB image at 115.34 MB/s Sep 25 13:40:49 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:40:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:49 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 Sep 25 13:40:49 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:50 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6" returned: 0 in 0.295s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-119f1909-605d-40c0-a01f-99b5e67507b6" released by "_copy_volume_from_snapshot" :: held 10.552s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Acquiring lock "cinder-quobyte-fc3a69ad-8d81-471e-b41f-796f64c13eec" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-fc3a69ad-8d81-471e-b41f-796f64c13eec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Deleting offline snapshot fc3a69ad-8d81-471e-b41f-796f64c13eec of volume 4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] snapshot_file for this snap is: volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d78ca-d572-4a55-8926-9ec9ecaa865d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:50 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec Sep 25 13:40:50 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:50 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec" returned: 0 in 0.477s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4914109-5ebd-4182-93dc-5b3c17c1cba8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:50 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd Sep 25 13:40:50 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:51 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd" returned: 0 in 0.631s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:51 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec Sep 25 13:40:51 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:51 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec" returned: 0 in 0.513s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:51 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec Sep 25 13:40:51 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:52 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd.fc3a69ad-8d81-471e-b41f-796f64c13eec" returned: 0 in 0.322s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-fc3a69ad-8d81-471e-b41f-796f64c13eec" released by "_delete_snapshot" :: held 2.090s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-a8aa6e1a-33e4-40e5-aa5c-e6039a3d8343 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.908s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-a8aa6e1a-33e4-40e5-aa5c-e6039a3d8343 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.766s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1883033360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb68f87d-a43b-45ef-a28d-80bb491f982f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9bb850cf184b46af9653bb7a6b87ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:40:46Z,use_quota=True,user_id='4d0b06c815294be281b382cfcd440604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Creating volume eb68f87d-a43b-45ef-a28d-80bb491f982f {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:40:52 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:52 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f 1073741824 Sep 25 13:40:52 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-a8aa6e1a-33e4-40e5-aa5c-e6039a3d8343 tempest-ServerActionsTestOtherA-1622259837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-9899f01a-d018-413d-abdf-3f070ef45984', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dde77e54-24b7-4050-8198-9bf8bf876674', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:40:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3fa62386-1367-47d5-b744-606823542436 tempest-GroupsV314Test-1482146879 None] Create group from source-group-5aeeea46-afb1-46a6-bd9c-6ddf01a717e0 completed successfully. Sep 25 13:40:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-446d2dbb-92ce-4741-bbc4-1620d5bb3488 req-a8aa6e1a-33e4-40e5-aa5c-e6039a3d8343 tempest-ServerActionsTestOtherA-1622259837 None] attachment_update completed successfully. Sep 25 13:40:53 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f 1073741824" returned: 0 in 0.781s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:53 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f Sep 25 13:40:53 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Acquiring lock "cinder-quobyte-119f1909-605d-40c0-a01f-99b5e67507b6" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-119f1909-605d-40c0-a01f-99b5e67507b6" acquired by "delete_volume" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94d1827-6dc8-402b-9e56-96da0483ea1f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:53 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f" returned: 0 in 0.715s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44c60f2-ba0d-44a6-9876-268a863fbbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb68f87d-a43b-45ef-a28d-80bb491f982f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2645e9f7-8b3d-44e4-919f-ac11d44be3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:40:53 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 Sep 25 13:40:53 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:53 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Volume volume-eb68f87d-a43b-45ef-a28d-80bb491f982f (eb68f87d-a43b-45ef-a28d-80bb491f982f): created successfully Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2645e9f7-8b3d-44e4-919f-ac11d44be3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:40:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Flow 'volume_create_manager' (6c100eec-894f-414d-aa2d-09ffbe0dd18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:40:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-776853d1-ac4d-4fbc-8c79-e73aa7e3be99 tempest-VolumeQuotasAdminTestJSON-150385311 None] Created volume successfully. Sep 25 13:40:54 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6" returned: 0 in 0.523s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:54 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6 Sep 25 13:40:54 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:54 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-119f1909-605d-40c0-a01f-99b5e67507b6" returned: 0 in 0.300s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-119f1909-605d-40c0-a01f-99b5e67507b6" released by "delete_volume" :: held 0.901s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Created reservations ['316066d5-dea1-433d-9aca-3582e28482e4'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:54 devstack cinder-volume[87220]: WARNING cinder.quota [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1251259841 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1251259841, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:40:54 devstack cinder-volume[87220]: WARNING cinder.quota [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1251259841 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1251259841, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Created reservations ['e8087142-62f9-4b9b-b33b-d07ee124234d', '3290d057-7b27-4a77-bce1-1b157ea9608c', 'ef77ec2c-1ed0-48a0-8880-af85a3d684c9', '484975e0-b2fb-42a1-b15c-3fae2910a00e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:55 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:55 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "cinder-eb68f87d-a43b-45ef-a28d-80bb491f982f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "cinder-eb68f87d-a43b-45ef-a28d-80bb491f982f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "cinder-quobyte-eb68f87d-a43b-45ef-a28d-80bb491f982f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:55 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.496s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "cinder-quobyte-eb68f87d-a43b-45ef-a28d-80bb491f982f" acquired by "delete_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bacd6f02-d0bd-42d9-b242-a6ed4d6f6cd8 tempest-GroupsV314Test-1482146879 None] Delete group completed successfully. Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[49962178-de04-4e2f-97e6-23f2d3078219]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Acquiring lock "cinder-quobyte-4d23e65b-9c5b-4a2b-b315-e186004d17cd" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-4d23e65b-9c5b-4a2b-b315-e186004d17cd" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:40:55 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f Sep 25 13:40:55 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b420581-73d1-4cef-a5ad-2a40289b67c2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:40:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:55 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd Sep 25 13:40:55 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:56 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f" returned: 0 in 0.475s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:56 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f Sep 25 13:40:56 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:56 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd" returned: 0 in 0.505s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:56 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd Sep 25 13:40:56 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:56 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb68f87d-a43b-45ef-a28d-80bb491f982f" returned: 0 in 0.488s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "cinder-quobyte-eb68f87d-a43b-45ef-a28d-80bb491f982f" released by "delete_volume" :: held 1.075s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Created reservations ['e7467b6e-58f1-4c53-a226-8512dc138211', '74f57a80-7e2e-43bb-ab3a-2540762125db', '1c1af06a-7bd6-406c-93f4-934399dd2b84', 'c162dd1a-76c8-4e17-ac32-d503c7fdbfb8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:56 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4d23e65b-9c5b-4a2b-b315-e186004d17cd" returned: 0 in 0.568s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Lock "cinder-quobyte-4d23e65b-9c5b-4a2b-b315-e186004d17cd" released by "delete_volume" :: held 1.284s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:56 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:56 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Created reservations ['a5212c68-2d16-4608-b965-c2bf4bfbb5cf'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Created reservations ['c233663e-b31b-4249-8b45-2be89841cded', '7cfe761e-3de9-4401-842a-87bb95c90ac6', 'efdc286a-cfff-4a85-b9da-3f601efe87dc', 'fa8de70a-e6c5-4094-8d4c-9c73ebf736f8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:40:57 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.522s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Deleted volume successfully. Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f4e622-330d-4e5d-a39f-69c6fe9dc483 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "cinder-eb68f87d-a43b-45ef-a28d-80bb491f982f-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:40:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:40:57 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:40:57 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:40:58 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Sep 25 13:40:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 1.026s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:40:58 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:40:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0491d54c-b92a-4f67-9dfe-91c797c95f9a tempest-GroupsV314Test-1482146879 None] Delete group completed successfully. Sep 25 13:40:59 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Flow 'volume_create_manager' (6625ee6b-71e1-4b5a-abc6-120c9baaa491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96de162-d1cb-4199-9925-4b68027f6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96de162-d1cb-4199-9925-4b68027f6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-127923531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255f616f-2708-4bcc-8862-6d5aa8986aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9bb850cf184b46af9653bb7a6b87ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:00Z,use_quota=True,user_id='4d0b06c815294be281b382cfcd440604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d1c87c-d279-4882-aa98-91ad77436a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d1c87c-d279-4882-aa98-91ad77436a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1910d827-e3cc-41a7-91a1-e8a97df725c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1910d827-e3cc-41a7-91a1-e8a97df725c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255f616f-2708-4bcc-8862-6d5aa8986aaa', 'volume_name': 'volume-255f616f-2708-4bcc-8862-6d5aa8986aaa', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f4a334-76f6-4374-9ef0-54ae5e64075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f4a334-76f6-4374-9ef0-54ae5e64075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c43c73-c05c-4a30-9898-cee8df968328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Volume 255f616f-2708-4bcc-8862-6d5aa8986aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255f616f-2708-4bcc-8862-6d5aa8986aaa', 'volume_size': 1} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-127923531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255f616f-2708-4bcc-8862-6d5aa8986aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9bb850cf184b46af9653bb7a6b87ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:00Z,use_quota=True,user_id='4d0b06c815294be281b382cfcd440604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Creating volume 255f616f-2708-4bcc-8862-6d5aa8986aaa {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:41:00 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:41:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:00 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa 1073741824 Sep 25 13:41:00 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:01 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa 1073741824" returned: 0 in 1.165s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:01 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa Sep 25 13:41:01 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:02 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa" returned: 0 in 1.079s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] <== create_volume: return (2436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c43c73-c05c-4a30-9898-cee8df968328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255f616f-2708-4bcc-8862-6d5aa8986aaa', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102fa6ea-3a62-4b27-9404-667a4927ff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Volume volume-255f616f-2708-4bcc-8862-6d5aa8986aaa (255f616f-2708-4bcc-8862-6d5aa8986aaa): created successfully Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102fa6ea-3a62-4b27-9404-667a4927ff27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Flow 'volume_create_manager' (6625ee6b-71e1-4b5a-abc6-120c9baaa491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7b17506e-2320-4297-b9ad-4c093ce8a574 tempest-VolumeQuotasAdminTestJSON-150385311 None] Created volume successfully. Sep 25 13:41:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bf1e6fb9-cad0-4f82-b4f9-68d9dd016722 tempest-VolumeQuotasAdminTestJSON-887684380 None] Transfer volume completed successfully. Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Acquiring lock "cinder-255f616f-2708-4bcc-8862-6d5aa8986aaa-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Lock "cinder-255f616f-2708-4bcc-8862-6d5aa8986aaa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Acquiring lock "cinder-quobyte-255f616f-2708-4bcc-8862-6d5aa8986aaa" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Lock "cinder-quobyte-255f616f-2708-4bcc-8862-6d5aa8986aaa" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ccb8b6-9528-444f-9485-3264006c9f12]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:07 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa Sep 25 13:41:07 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:07 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa" returned: 0 in 0.648s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:08 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa Sep 25 13:41:08 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:08 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-255f616f-2708-4bcc-8862-6d5aa8986aaa" returned: 0 in 0.594s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Lock "cinder-quobyte-255f616f-2708-4bcc-8862-6d5aa8986aaa" released by "delete_volume" :: held 1.350s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Created reservations ['f6e1e03a-8fbc-4ac2-bc39-6c58166c5a11', '77865da8-e396-4a55-a8e2-7b81296d771f', '64964223-ca5c-42b6-abea-ea1f50f4658f', '162a702a-e742-438d-b8b2-dc1cdc257246'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:08 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:08 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:09 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Deleted volume successfully. Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-983fac78-3eec-4df8-9a30-018515d2f12c tempest-VolumeQuotasAdminTestJSON-1269977229 None] Lock "cinder-255f616f-2708-4bcc-8862-6d5aa8986aaa-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:09 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:09 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:10 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.547s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:41:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:41:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:41:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ec32e72e-10a2-4d9b-8c15-4ff4312dbd2f tempest-GroupsV320Test-1743306553 None] Group tempest-GroupsV320Test-Group-429094946: creating Sep 25 13:41:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ec32e72e-10a2-4d9b-8c15-4ff4312dbd2f tempest-GroupsV320Test-1743306553 None] Group tempest-GroupsV320Test-Group-429094946: created successfully Sep 25 13:41:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ec32e72e-10a2-4d9b-8c15-4ff4312dbd2f tempest-GroupsV320Test-1743306553 None] Create group completed successfully. Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Created reservations ['02e2d71f-bdff-4656-bee1-9a7240596f0a'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:16 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:16 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:17 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.417s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:17 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-cff91f6d-2432-4a54-9c52-f51f8a56e212 tempest-GroupsV320Test-1743306553 None] Delete group completed successfully. Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Flow 'volume_create_manager' (5aee71db-d41a-495b-ae9f-d91319a28f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f47051f-8f1e-4f8f-a102-f3b717961e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f47051f-8f1e-4f8f-a102-f3b717961e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1838692131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c1c5e4-7b20-4d97-967d-a75b85f3e291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50eba9f8acb445f1b970e00882c1111a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:22Z,use_quota=True,user_id='f1bcf3a840e1464b848010b4bf23102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92358233-77fc-4e48-8946-c0ca0d7a9be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92358233-77fc-4e48-8946-c0ca0d7a9be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dd57e5-3965-40fe-b616-304db95f7b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dd57e5-3965-40fe-b616-304db95f7b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c1c5e4-7b20-4d97-967d-a75b85f3e291', 'volume_name': 'volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e21c6d-41ca-49c6-bd4e-27e1273ff8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e21c6d-41ca-49c6-bd4e-27e1273ff8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600315aa-3caa-491c-9959-eb909a8f9bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Volume 13c1c5e4-7b20-4d97-967d-a75b85f3e291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291', 'volume_size': 1} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1838692131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c1c5e4-7b20-4d97-967d-a75b85f3e291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50eba9f8acb445f1b970e00882c1111a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:22Z,use_quota=True,user_id='f1bcf3a840e1464b848010b4bf23102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Creating volume 13c1c5e4-7b20-4d97-967d-a75b85f3e291 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:41:22 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:22 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 1073741824 Sep 25 13:41:22 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:22 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 1073741824" returned: 0 in 0.491s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:22 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 Sep 25 13:41:22 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:23 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291" returned: 0 in 0.287s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600315aa-3caa-491c-9959-eb909a8f9bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecf67af-69fc-455c-8dbe-cff20bd1665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:23 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Volume volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 (13c1c5e4-7b20-4d97-967d-a75b85f3e291): created successfully Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecf67af-69fc-455c-8dbe-cff20bd1665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Flow 'volume_create_manager' (5aee71db-d41a-495b-ae9f-d91319a28f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5ed98e0d-7b09-47cc-a3f6-5ee971c77b91 tempest-VolumesServicesTestJSON-1612590323 None] Created volume successfully. Sep 25 13:41:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Acquiring lock "cinder-13c1c5e4-7b20-4d97-967d-a75b85f3e291-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Lock "cinder-13c1c5e4-7b20-4d97-967d-a75b85f3e291-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Acquiring lock "cinder-quobyte-13c1c5e4-7b20-4d97-967d-a75b85f3e291" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Lock "cinder-quobyte-13c1c5e4-7b20-4d97-967d-a75b85f3e291" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:24 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c54bbf-7bee-47a0-8381-210842813ea4]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:24 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 Sep 25 13:41:24 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:25 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291" returned: 0 in 0.486s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:25 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291 Sep 25 13:41:25 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:25 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-13c1c5e4-7b20-4d97-967d-a75b85f3e291" returned: 0 in 0.348s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Lock "cinder-quobyte-13c1c5e4-7b20-4d97-967d-a75b85f3e291" released by "delete_volume" :: held 0.889s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Created reservations ['662614b1-5977-4d03-a7f8-b27f4c1fbccf', '5deda13b-67db-49ca-97cb-60c09f87cac0', '28e34214-86ef-4a12-a111-4db72f3948c1', '85d3d7e1-a309-4e79-aa57-9cf7f7f518c2'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:25 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:25 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:26 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:26 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Deleted volume successfully. Sep 25 13:41:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97e1cb7d-a80b-48fc-bae2-4231464a84b4 tempest-VolumesServicesTestJSON-1612590323 None] Lock "cinder-13c1c5e4-7b20-4d97-967d-a75b85f3e291-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Flow 'volume_create_manager' (50311865-b57f-4142-a8da-006c147d0b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e98ea-e597-44c0-948a-a9526031abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e98ea-e597-44c0-948a-a9526031abc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1216762332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e029a39e-65be-4bbd-8450-940fc1548399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbf75c1175d46a1814421605a86bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:29Z,use_quota=True,user_id='124a8d209f8e4ab8a41656c92c5fdc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b394b8-e69f-4465-b396-57eb1870f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b394b8-e69f-4465-b396-57eb1870f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8836cbca-f4ac-463a-b259-03b68a510d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8836cbca-f4ac-463a-b259-03b68a510d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e029a39e-65be-4bbd-8450-940fc1548399', 'volume_name': 'volume-e029a39e-65be-4bbd-8450-940fc1548399', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a216c0-2332-4c50-8842-9f4f075787e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a216c0-2332-4c50-8842-9f4f075787e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f0b797-4ce6-4689-9c4e-01fc8dff6cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Volume e029a39e-65be-4bbd-8450-940fc1548399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e029a39e-65be-4bbd-8450-940fc1548399', 'volume_size': 1} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1216762332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e029a39e-65be-4bbd-8450-940fc1548399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbf75c1175d46a1814421605a86bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:29Z,use_quota=True,user_id='124a8d209f8e4ab8a41656c92c5fdc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Creating volume e029a39e-65be-4bbd-8450-940fc1548399 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:41:29 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:41:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:29 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 1073741824 Sep 25 13:41:29 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:30 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 1073741824" returned: 0 in 0.632s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:30 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 Sep 25 13:41:30 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:30 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f0b797-4ce6-4689-9c4e-01fc8dff6cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e029a39e-65be-4bbd-8450-940fc1548399', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8c6360-3517-420e-b9d8-2fec0d0abeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:30 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Volume volume-e029a39e-65be-4bbd-8450-940fc1548399 (e029a39e-65be-4bbd-8450-940fc1548399): created successfully Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8c6360-3517-420e-b9d8-2fec0d0abeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Flow 'volume_create_manager' (50311865-b57f-4142-a8da-006c147d0b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b945b918-452b-4902-84d9-8fc86e1f1565 tempest-AttachVolumeNegativeTest-767953356 None] Created volume successfully. Sep 25 13:41:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-02db4947-3757-45c7-855b-63165883e63c req-e1ae72df-11cc-42c8-ba42-68709784c230 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-02db4947-3757-45c7-855b-63165883e63c req-e1ae72df-11cc-42c8-ba42-68709784c230 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-02db4947-3757-45c7-855b-63165883e63c req-e1ae72df-11cc-42c8-ba42-68709784c230 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-02db4947-3757-45c7-855b-63165883e63c req-e1ae72df-11cc-42c8-ba42-68709784c230 tempest-AttachVolumeNegativeTest-767953356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-e029a39e-65be-4bbd-8450-940fc1548399', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1eab1ec3-85e6-4281-8297-321329fa49a1', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:41:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-02db4947-3757-45c7-855b-63165883e63c req-e1ae72df-11cc-42c8-ba42-68709784c230 tempest-AttachVolumeNegativeTest-767953356 None] attachment_update completed successfully. Sep 25 13:41:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-0bc9f90f-144d-4b60-a62c-1bdf1a585506 req-8d80a4c7-e3d3-4682-9924-466af99221ae tempest-AttachVolumeNegativeTest-767953356 None] Terminate volume connection completed successfully. Sep 25 13:41:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-0bc9f90f-144d-4b60-a62c-1bdf1a585506 req-8d80a4c7-e3d3-4682-9924-466af99221ae tempest-AttachVolumeNegativeTest-767953356 None] Deleting attachment 1eab1ec3-85e6-4281-8297-321329fa49a1. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:41:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "cinder-e029a39e-65be-4bbd-8450-940fc1548399-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-e029a39e-65be-4bbd-8450-940fc1548399-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "cinder-quobyte-e029a39e-65be-4bbd-8450-940fc1548399" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-quobyte-e029a39e-65be-4bbd-8450-940fc1548399" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:42 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f2d6a-50b8-4e23-9a8d-3df2f559cad7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:42 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 Sep 25 13:41:42 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:43 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399" returned: 0 in 0.579s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:43 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399 Sep 25 13:41:43 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:43 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e029a39e-65be-4bbd-8450-940fc1548399" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-quobyte-e029a39e-65be-4bbd-8450-940fc1548399" released by "delete_volume" :: held 1.072s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Created reservations ['04a499b3-4ea4-4e66-b18f-efbe70a13f02', 'fc9a4087-7aee-4310-b1dd-633a1042b39b', '2d1d1056-4df9-4327-b2c1-b61a03078881', '3f095f8e-6b7b-43e3-8444-1bf7faa329d2'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:43 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:43 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.443s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:44 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:44 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Deleted volume successfully. Sep 25 13:41:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-59e4fb31-c075-4144-93b1-d7823dafd4ff tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-e029a39e-65be-4bbd-8450-940fc1548399-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "cinder-14a1c593-02cd-4bff-8e6b-af6cc5368565-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-14a1c593-02cd-4bff-8e6b-af6cc5368565-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "cinder-quobyte-14a1c593-02cd-4bff-8e6b-af6cc5368565" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-quobyte-14a1c593-02cd-4bff-8e6b-af6cc5368565" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adab1b1-3d2f-44e5-8386-4947a638dd46]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:45 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 Sep 25 13:41:45 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:45 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565" returned: 0 in 0.612s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:45 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565 Sep 25 13:41:45 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:46 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-14a1c593-02cd-4bff-8e6b-af6cc5368565" returned: 0 in 0.433s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-quobyte-14a1c593-02cd-4bff-8e6b-af6cc5368565" released by "delete_volume" :: held 1.123s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Created reservations ['926dce30-fee7-4e39-84eb-058de80c14ba', 'c52b0bd1-2289-4737-b3c2-29e4723e009b', '16de5446-af67-4dcf-88b1-91d9d8e1e7ce', '04497063-0f9f-4b67-89c7-3007b1433d48'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:46 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:46 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=73,cinder:UPDATE=85,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=81,cinder:SELECT=71,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:41:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-440851d6-e1f6-48f6-80f4-e799cae25dc3 tempest-ServerActionsTestOtherA-1622259837 None] Terminate volume connection completed successfully. Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-440851d6-e1f6-48f6-80f4-e799cae25dc3 tempest-ServerActionsTestOtherA-1622259837 None] Deleting attachment dde77e54-24b7-4050-8198-9bf8bf876674. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:41:46 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.355s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Deleted volume successfully. Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8dee93f7-731d-4297-a813-0a5467e2e498 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-14a1c593-02cd-4bff-8e6b-af6cc5368565-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "cinder-9899f01a-d018-413d-abdf-3f070ef45984-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-9899f01a-d018-413d-abdf-3f070ef45984-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "cinder-quobyte-9899f01a-d018-413d-abdf-3f070ef45984" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-quobyte-9899f01a-d018-413d-abdf-3f070ef45984" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5620427b-4164-4db5-ace6-72628e957825]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:47 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 Sep 25 13:41:47 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "cinder-326e1694-bfe9-4713-abf0-f0b83b5ea10e-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:47 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984" returned: 0 in 0.701s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-326e1694-bfe9-4713-abf0-f0b83b5ea10e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:47 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984 Sep 25 13:41:47 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "cinder-quobyte-326e1694-bfe9-4713-abf0-f0b83b5ea10e" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-quobyte-326e1694-bfe9-4713-abf0-f0b83b5ea10e" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc084b15-7b8a-4050-923b-a8b5b5f6d8c6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:48 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e Sep 25 13:41:48 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:48 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9899f01a-d018-413d-abdf-3f070ef45984" returned: 0 in 0.367s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-quobyte-9899f01a-d018-413d-abdf-3f070ef45984" released by "delete_volume" :: held 1.140s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.quota [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Created reservations ['5edfa9dd-2e78-4f2f-b4a4-0d4aa7b40c2a', '91cc6f77-2082-4c0c-add8-a3c7ad93cb0b', 'a8d18b3c-49fd-4ef2-83fa-6dc222d5b977', '2c793637-007b-40c5-989e-53d60cffd327'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:48 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:48 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:48 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e" returned: 0 in 0.581s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:48 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e Sep 25 13:41:48 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Flow 'volume_create_manager' (56a4e3b5-56ed-4c5d-8c91-0538c8b53f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90847957-3f9c-4b54-a3ad-0eda6763ea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90847957-3f9c-4b54-a3ad-0eda6763ea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-601308048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ce8036-9bd7-4abd-ae84-0581d7ce1fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39ba9fdd29c437f8f02e28e277be709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:48Z,use_quota=True,user_id='0b6b7356a8174f0ba07d0fcff8c98a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c40269-bc8b-4281-b18e-cf98b75c3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c40269-bc8b-4281-b18e-cf98b75c3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb42937-9c43-4f4b-9e85-1b5d46e09ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb42937-9c43-4f4b-9e85-1b5d46e09ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ce8036-9bd7-4abd-ae84-0581d7ce1fae', 'volume_name': 'volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b567198-3e10-418e-a2f2-6d81cc4de064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b567198-3e10-418e-a2f2-6d81cc4de064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc16d0-dc0b-43fa-b6b8-9d3ea157704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Volume 39ce8036-9bd7-4abd-ae84-0581d7ce1fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae', 'volume_size': 1} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-601308048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ce8036-9bd7-4abd-ae84-0581d7ce1fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39ba9fdd29c437f8f02e28e277be709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:41:48Z,use_quota=True,user_id='0b6b7356a8174f0ba07d0fcff8c98a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Creating volume 39ce8036-9bd7-4abd-ae84-0581d7ce1fae {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:41:48 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:48 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae 1073741824 Sep 25 13:41:48 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:48 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.366s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.manager [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Deleted volume successfully. Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-f8324be3-98d3-476f-9b8b-462d1038d68f req-3d574ae0-a215-4b09-a771-1589495d27d0 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-9899f01a-d018-413d-abdf-3f070ef45984-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:48 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-326e1694-bfe9-4713-abf0-f0b83b5ea10e" returned: 0 in 0.368s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-quobyte-326e1694-bfe9-4713-abf0-f0b83b5ea10e" released by "delete_volume" :: held 1.029s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:48 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Created reservations ['c60172e8-bd44-4b26-be00-27919a782061', 'ba34e641-a9b0-44b0-9f2a-dcdb0e12d1f2', '26974a51-facd-4d72-8dc8-02b8d8726500', '19f185da-470a-42b4-ade1-6473900f6e2c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "cinder-f1c2578d-78f5-4454-a216-d704bc16005e-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-f1c2578d-78f5-4454-a216-d704bc16005e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:49 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:49 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "cinder-quobyte-f1c2578d-78f5-4454-a216-d704bc16005e" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-quobyte-f1c2578d-78f5-4454-a216-d704bc16005e" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e457bddb-851f-47eb-aa21-91171949d07f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:49 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae 1073741824" returned: 0 in 0.722s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:49 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:49 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:49 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.360s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Deleted volume successfully. Sep 25 13:41:49 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae Sep 25 13:41:49 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16b12954-4594-47dd-8d4f-bfff212fa8a4 tempest-AttachVolumeNegativeTest-767953356 None] Lock "cinder-326e1694-bfe9-4713-abf0-f0b83b5ea10e-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:49 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:49 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae" returned: 0 in 0.393s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e" returned: 0 in 0.582s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:49 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e Sep 25 13:41:49 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc16d0-dc0b-43fa-b6b8-9d3ea157704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c505bffa-68bd-42cd-a9f2-e5b610759877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:41:49 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Volume volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae (39ce8036-9bd7-4abd-ae84-0581d7ce1fae): created successfully Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c505bffa-68bd-42cd-a9f2-e5b610759877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:41:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Flow 'volume_create_manager' (56a4e3b5-56ed-4c5d-8c91-0538c8b53f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:41:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-cf458b00-27e9-4cb8-b354-06d8410460d1 tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Created volume successfully. Sep 25 13:41:50 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f1c2578d-78f5-4454-a216-d704bc16005e" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-quobyte-f1c2578d-78f5-4454-a216-d704bc16005e" released by "delete_volume" :: held 0.919s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Created reservations ['8bfdc2a8-12b8-4e42-a9ff-53bde358e2f0', '8b328231-d645-47ed-9143-07e38d193011', '0103f304-08e7-432d-a602-80ce435952d3', 'af3136c9-47f8-4104-ace8-e5357c3462c9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:50 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:50 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:50 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Deleted volume successfully. Sep 25 13:41:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-48e0088b-33c5-432f-a680-b1d4d055e939 tempest-ServerActionsTestOtherA-1622259837 None] Lock "cinder-f1c2578d-78f5-4454-a216-d704bc16005e-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Acquiring lock "cinder-39ce8036-9bd7-4abd-ae84-0581d7ce1fae-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "cinder-39ce8036-9bd7-4abd-ae84-0581d7ce1fae-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Acquiring lock "cinder-quobyte-39ce8036-9bd7-4abd-ae84-0581d7ce1fae" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:41:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "cinder-quobyte-39ce8036-9bd7-4abd-ae84-0581d7ce1fae" acquired by "delete_volume" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:41:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e20b473-700c-4a04-b632-0fe08f80eec8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:41:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:52 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae Sep 25 13:41:52 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:53 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae" returned: 0 in 0.521s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:53 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae Sep 25 13:41:53 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:53 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-39ce8036-9bd7-4abd-ae84-0581d7ce1fae" returned: 0 in 0.302s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "cinder-quobyte-39ce8036-9bd7-4abd-ae84-0581d7ce1fae" released by "delete_volume" :: held 0.921s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Created reservations ['aad905fa-97df-4af7-b579-6f955692fe28', '29a69a3a-c455-419f-ab3c-e2688b282f75', '040764f0-7667-4ffd-a1cb-0f6d3d62282a', '0b5fe414-82e4-4e69-a787-6abe5caf7eef'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:41:53 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:41:53 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:41:53 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.367s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:41:53 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:41:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Deleted volume successfully. Sep 25 13:41:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6e9d63bc-9d0b-4122-a9fa-17dc5be7871d tempest-VolumeQuotasNegativeTestJSON-1980139019 None] Lock "cinder-39ce8036-9bd7-4abd-ae84-0581d7ce1fae-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:03 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:DELETE=4,cinder:UPDATE=31,cinder:SELECT=19,cinder:INSERT=8 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:42:04 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=25,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:09 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:42:09 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:10 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:42:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:42:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:42:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Flow 'volume_create_manager' (86a8852c-36be-4465-aa7c-ab28d840393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4558aa2e-4a10-4657-a00a-ff86170582ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4558aa2e-4a10-4657-a00a-ff86170582ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1644087542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ceb85eb2cc045c8b1b34153ebf47665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:16Z,use_quota=True,user_id='07ff612002d44fa28d3bbabcbddaebbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08036bf-dbe7-4b9b-ab43-790592d804d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08036bf-dbe7-4b9b-ab43-790592d804d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dd5bac-e7e7-4743-941f-bedc4cc4e1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dd5bac-e7e7-4743-941f-bedc4cc4e1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba', 'volume_name': 'volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71428bb-b037-4635-8ab6-08089a6926a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71428bb-b037-4635-8ab6-08089a6926a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc73c1dd-997b-4654-8fb7-e1bd1a0e2b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Volume 30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba', 'volume_size': 1} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1644087542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ceb85eb2cc045c8b1b34153ebf47665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:16Z,use_quota=True,user_id='07ff612002d44fa28d3bbabcbddaebbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Creating volume 30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:42:15 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:42:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:15 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba 1073741824 Sep 25 13:42:15 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:16 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba 1073741824" returned: 0 in 0.824s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:16 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba Sep 25 13:42:16 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:17 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc73c1dd-997b-4654-8fb7-e1bd1a0e2b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461cf1a8-0e05-4030-8b5c-1e693a23cc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:17 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Volume volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba (30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba): created successfully Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461cf1a8-0e05-4030-8b5c-1e693a23cc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Flow 'volume_create_manager' (86a8852c-36be-4465-aa7c-ab28d840393b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c6eb29e6-fa6f-46db-8aac-0a10f7eb1071 tempest-SnapshotMetadataTestJSON-1811846176 None] Created volume successfully. Sep 25 13:42:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Creating offline snapshot 4618d411-653f-4ca6-a383-431f39b8d136 of volume 30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:42:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[181abca8-bd01-4b07-832d-50aa90ba9447]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:18 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba Sep 25 13:42:18 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:18 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" returned: 0 in 0.673s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:19 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 1G Sep 25 13:42:19 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:19 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 1G" returned: 0 in 0.570s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:19 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 Sep 25 13:42:19 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:19 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136" returned: 0 in 0.394s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:19 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 is being set with open permissions: ugo+rw Sep 25 13:42:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:20 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 Sep 25 13:42:20 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:20 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136" returned: 0 in 0.385s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:20 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info Sep 25 13:42:20 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:20 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:20 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info is being set with open permissions: ugo+rw Sep 25 13:42:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:20 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info Sep 25 13:42:20 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:20 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.info" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-967a87a3-7ab4-41a0-bb0b-d3db0439751f tempest-SnapshotMetadataTestJSON-1811846176 None] Create snapshot completed successfully Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "cinder-4618d411-653f-4ca6-a383-431f39b8d136-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-4618d411-653f-4ca6-a383-431f39b8d136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "cinder-quobyte-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-quobyte-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "cinder-quobyte-4618d411-653f-4ca6-a383-431f39b8d136" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-quobyte-4618d411-653f-4ca6-a383-431f39b8d136" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Deleting offline snapshot 4618d411-653f-4ca6-a383-431f39b8d136 of volume 30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] snapshot_file for this snap is: volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbdc735-dd7b-4daa-b509-7c625f520669]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:23 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 Sep 25 13:42:23 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:23 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136" returned: 0 in 0.638s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6cf523-d3ff-4212-8c10-ebeb70cab017]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:23 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba Sep 25 13:42:23 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:24 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" returned: 0 in 0.629s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:24 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 Sep 25 13:42:24 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:24 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136" returned: 0 in 0.543s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:24 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136 Sep 25 13:42:24 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:25 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba.4618d411-653f-4ca6-a383-431f39b8d136" returned: 0 in 0.406s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-quobyte-4618d411-653f-4ca6-a383-431f39b8d136" released by "_delete_snapshot" :: held 2.428s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-quobyte-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" released by "delete_snapshot" :: held 2.468s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:25 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Created reservations ['dcb4c83c-37fc-496d-b3be-a0c48df89e52', '40753f5b-dd10-409f-b20c-422a6169aebb', '2fcb9f72-a4e6-4d32-ac24-6d7fa641e440', '1d739923-0ef0-47d1-b009-6cb0302b7d4f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:42:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Delete snapshot completed successfully. Sep 25 13:42:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bcd023b2-839e-404f-8b67-88039c0d0b56 tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-4618d411-653f-4ca6-a383-431f39b8d136-delete_snapshot" released by "delete_snapshot" :: held 2.786s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "cinder-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "cinder-quobyte-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-quobyte-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4271a2f-6ad5-414f-9784-aef64c25985f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:26 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba Sep 25 13:42:26 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:26 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" returned: 0 in 0.706s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:26 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba Sep 25 13:42:26 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:27 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" returned: 0 in 0.450s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-quobyte-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba" released by "delete_volume" :: held 1.280s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Created reservations ['8b19abd5-e18a-41bd-9aaa-693d1046d421', 'faa5381d-ad7d-431a-a2df-4aa8214917e7', 'd8685a3c-ae84-4c18-a0ec-07302d1bc594', '251f936c-0160-42cd-98ea-80a2ec1c9d96'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:27 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:42:27 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:28 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:28 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:42:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Deleted volume successfully. Sep 25 13:42:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-517a51a3-4f91-45bc-a584-19d368ed63ae tempest-SnapshotMetadataTestJSON-1811846176 None] Lock "cinder-30dc459e-bdcc-4218-8e6c-5e2e37fcf1ba-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Flow 'volume_create_manager' (7b5eb838-e052-41c5-89e5-b3731bbf89bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcc21f1-9668-4640-91b9-a1ad9cf7b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcc21f1-9668-4640-91b9-a1ad9cf7b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-815845108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d374071d-b251-4e06-90bf-6152405c6822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d916c08f2ec4493b82899938ec4ddd8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:32Z,use_quota=True,user_id='4c21455b9cab49c0b97e4bce10fdbc12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56967a36-19b9-4d17-a62b-9bcd3e030390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56967a36-19b9-4d17-a62b-9bcd3e030390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de75966-e371-4a41-af72-21cc88f3afc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de75966-e371-4a41-af72-21cc88f3afc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd374071d-b251-4e06-90bf-6152405c6822', 'volume_name': 'volume-d374071d-b251-4e06-90bf-6152405c6822', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f941865-632d-41cd-a069-918ae6006ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f941865-632d-41cd-a069-918ae6006ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988f346d-ea8a-4fcb-9bf8-5b178350692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Volume d374071d-b251-4e06-90bf-6152405c6822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d374071d-b251-4e06-90bf-6152405c6822', 'volume_size': 1} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-815845108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d374071d-b251-4e06-90bf-6152405c6822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d916c08f2ec4493b82899938ec4ddd8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:32Z,use_quota=True,user_id='4c21455b9cab49c0b97e4bce10fdbc12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Creating volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:42:32 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:42:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:32 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 1073741824 Sep 25 13:42:32 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:33 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 1073741824" returned: 0 in 0.813s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:33 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 Sep 25 13:42:33 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:33 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822" returned: 0 in 0.330s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988f346d-ea8a-4fcb-9bf8-5b178350692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d374071d-b251-4e06-90bf-6152405c6822', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472277e8-2826-4c7a-bb37-f5080588203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:33 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Volume volume-d374071d-b251-4e06-90bf-6152405c6822 (d374071d-b251-4e06-90bf-6152405c6822): created successfully Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472277e8-2826-4c7a-bb37-f5080588203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Flow 'volume_create_manager' (7b5eb838-e052-41c5-89e5-b3731bbf89bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1d8362a4-21fd-412f-98dd-438cfeebefd9 tempest-SnapshotsActionsTest-373408164 None] Created volume successfully. Sep 25 13:42:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Creating offline snapshot b8fc2dcc-6b77-43eb-958f-2a4caef9db77 of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:42:34 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3f6c0-a60e-40ac-8b82-418baad66823]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:35 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 Sep 25 13:42:35 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:35 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822" returned: 0 in 0.528s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:35 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 1G Sep 25 13:42:35 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:36 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 1G" returned: 0 in 0.632s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:36 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:36 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:36 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.369s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:36 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 is being set with open permissions: ugo+rw Sep 25 13:42:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:36 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:36 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:36 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.276s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:36 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info Sep 25 13:42:36 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:37 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info" returned: 0 in 0.332s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:37 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info is being set with open permissions: ugo+rw Sep 25 13:42:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:37 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info Sep 25 13:42:37 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:37 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.info" returned: 0 in 0.275s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bba3d589-3f81-4d70-9f5c-99b7f1b512de tempest-SnapshotsActionsTest-373408164 None] Create snapshot completed successfully Sep 25 13:42:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Creating offline snapshot df1e7325-9fd0-43a3-ae7d-231f715a8a97 of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:42:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cb17b2-0b57-4e8c-bf2c-f84dc29471fa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:39 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:39 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:40 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.697s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:40 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 1G Sep 25 13:42:40 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:41 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 1G" returned: 0 in 0.861s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:41 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 Sep 25 13:42:41 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:41 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97" returned: 0 in 0.769s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:41 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 is being set with open permissions: ugo+rw Sep 25 13:42:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:41 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 Sep 25 13:42:41 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:42 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f9f836b5-f9be-4d03-a350-4a54eb19f401 tempest-SnapshotsActionsTest-373408164 None] Create snapshot completed successfully Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-df1e7325-9fd0-43a3-ae7d-231f715a8a97-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-df1e7325-9fd0-43a3-ae7d-231f715a8a97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-df1e7325-9fd0-43a3-ae7d-231f715a8a97" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-df1e7325-9fd0-43a3-ae7d-231f715a8a97" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Deleting offline snapshot df1e7325-9fd0-43a3-ae7d-231f715a8a97 of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] snapshot_file for this snap is: volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da11eca-c538-42d2-9b9f-e7b099dbcb78]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:43 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 Sep 25 13:42:43 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:44 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97" returned: 0 in 0.736s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[58902051-23e8-4a86-918b-cb1a7e7357fc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:44 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:44 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:44 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.683s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:44 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 Sep 25 13:42:44 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:45 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97" returned: 0 in 0.817s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:45 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97 Sep 25 13:42:45 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:42:46 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (10173279-79bc-42f0-b15d-93a82c63a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fca680-565e-4dde-a4c7-1118cdfe5508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.df1e7325-9fd0-43a3-ae7d-231f715a8a97" returned: 0 in 0.604s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fca680-565e-4dde-a4c7-1118cdfe5508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131933116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56dcf7a1-a265-495f-8ec7-f7f4ca925154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:46Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb190fb-7b8b-418c-ae32-cdeca70b35aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb190fb-7b8b-418c-ae32-cdeca70b35aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed26c29-0466-4013-bc85-b61a68025794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed26c29-0466-4013-bc85-b61a68025794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56dcf7a1-a265-495f-8ec7-f7f4ca925154', 'volume_name': 'volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7570433-1d34-4223-a077-9350c5a05a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7570433-1d34-4223-a077-9350c5a05a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4651dffb-27e4-4f76-9438-6db3b425cd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Volume 56dcf7a1-a265-495f-8ec7-f7f4ca925154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154', 'volume_size': 1} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131933116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56dcf7a1-a265-495f-8ec7-f7f4ca925154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:46Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Creating volume 56dcf7a1-a265-495f-8ec7-f7f4ca925154 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:42:46 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-df1e7325-9fd0-43a3-ae7d-231f715a8a97" released by "_delete_snapshot" :: held 3.177s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" released by "delete_snapshot" :: held 3.231s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:46 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 1073741824 Sep 25 13:42:46 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Created reservations ['0cd5d0c0-0e04-4448-b88a-e34413c33155', '885ec674-3d29-42d3-949e-9dde62720e74', 'dcf52de4-ebb9-4307-b91b-e826d97835e3', '20412dbb-793a-4692-a92c-20125ade69c0'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:42:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Delete snapshot completed successfully. Sep 25 13:42:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-702a4d28-c11a-47d4-aa99-d151d37489f2 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-df1e7325-9fd0-43a3-ae7d-231f715a8a97-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:47 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 1073741824" returned: 0 in 0.852s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:47 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 Sep 25 13:42:47 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:47 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154" returned: 0 in 0.487s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4651dffb-27e4-4f76-9438-6db3b425cd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab957ddb-845d-4757-9160-746d275951a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Volume volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 (56dcf7a1-a265-495f-8ec7-f7f4ca925154): created successfully Sep 25 13:42:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab957ddb-845d-4757-9160-746d275951a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (10173279-79bc-42f0-b15d-93a82c63a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-95c9c1af-6cc8-4fe1-9bf7-9c769510df3c tempest-VolumesActionsTest-1751990081 None] Created volume successfully. Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Creating offline snapshot 1edcc9d4-494f-4c76-8eaf-e26d461880bf of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e1c15f1a-9b66-45a6-91fa-c677f2d28f0e tempest-VolumesActionsTest-1751990081 None] Acquiring lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154" by "attach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f800cd2f-b48d-4e92-abd3-f758cfde7268]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e1c15f1a-9b66-45a6-91fa-c677f2d28f0e tempest-VolumesActionsTest-1751990081 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154" acquired by "attach_volume" :: waited 0.059s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e1c15f1a-9b66-45a6-91fa-c677f2d28f0e tempest-VolumesActionsTest-1751990081 None] Attaching volume 56dcf7a1-a265-495f-8ec7-f7f4ca925154 to instance f102966a-2ee5-448b-95af-5d6623e9a4a5 at mountpoint /dev/vdb on host None. Sep 25 13:42:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e1c15f1a-9b66-45a6-91fa-c677f2d28f0e tempest-VolumesActionsTest-1751990081 None] Attach volume completed successfully. Sep 25 13:42:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e1c15f1a-9b66-45a6-91fa-c677f2d28f0e tempest-VolumesActionsTest-1751990081 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154" released by "attach_volume" :: held 0.221s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:48 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:48 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:49 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.976s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:49 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf 1G Sep 25 13:42:49 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-35f23fca-9d62-43ed-9f30-b6defa8ddaa1 tempest-VolumesActionsTest-536508034 None] Terminate volume connection completed successfully. Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-35f23fca-9d62-43ed-9f30-b6defa8ddaa1 tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-detach_volume" by "detach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-35f23fca-9d62-43ed-9f30-b6defa8ddaa1 tempest-VolumesActionsTest-536508034 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-35f23fca-9d62-43ed-9f30-b6defa8ddaa1 tempest-VolumesActionsTest-536508034 None] Detaching volume 56dcf7a1-a265-495f-8ec7-f7f4ca925154 from instance f102966a-2ee5-448b-95af-5d6623e9a4a5. Sep 25 13:42:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-35f23fca-9d62-43ed-9f30-b6defa8ddaa1 tempest-VolumesActionsTest-536508034 None] Detach volume completed successfully. Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-35f23fca-9d62-43ed-9f30-b6defa8ddaa1 tempest-VolumesActionsTest-536508034 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:50 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf 1G" returned: 0 in 1.076s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:50 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf Sep 25 13:42:50 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7564d591-efc1-42d1-868c-7309fdf1d571 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-detach_volume" by "detach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7564d591-efc1-42d1-868c-7309fdf1d571 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-detach_volume" acquired by "detach_volume" :: waited 0.090s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7564d591-efc1-42d1-868c-7309fdf1d571 tempest-VolumesActionsTest-1751990081 None] Volume detach called, but volume not attached. Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7564d591-efc1-42d1-868c-7309fdf1d571 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:51 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf" returned: 0 in 0.829s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:51 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf is being set with open permissions: ugo+rw Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:51 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf Sep 25 13:42:51 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "cinder-quobyte-56dcf7a1-a265-495f-8ec7-f7f4ca925154" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-quobyte-56dcf7a1-a265-495f-8ec7-f7f4ca925154" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39d8490-9eda-42ee-981e-fc136d3e5d4c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:52 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 Sep 25 13:42:52 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:52 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf" returned: 0 in 0.913s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d2895e6e-fce6-402c-b81d-826903812ba0 tempest-SnapshotsActionsTest-373408164 None] Create snapshot completed successfully Sep 25 13:42:53 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154" returned: 0 in 1.026s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:53 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154 Sep 25 13:42:53 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-1edcc9d4-494f-4c76-8eaf-e26d461880bf-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-1edcc9d4-494f-4c76-8eaf-e26d461880bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-1edcc9d4-494f-4c76-8eaf-e26d461880bf" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-1edcc9d4-494f-4c76-8eaf-e26d461880bf" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Deleting offline snapshot 1edcc9d4-494f-4c76-8eaf-e26d461880bf of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] snapshot_file for this snap is: volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:42:53 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-56dcf7a1-a265-495f-8ec7-f7f4ca925154" returned: 0 in 0.473s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[39515889-47b4-4e4f-a84e-f90865dac24c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-quobyte-56dcf7a1-a265-495f-8ec7-f7f4ca925154" released by "delete_volume" :: held 1.636s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Created reservations ['9a11cd7b-0f72-4128-b3b9-060f46179b82', '2b2d6baf-2452-498b-852b-ba71544334de', '90483a3b-0777-4c49-8b0f-40a92d56581b', 'ce03e7ff-2f6a-4751-8002-daab51e7bb32'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:42:53 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf Sep 25 13:42:53 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:54 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:42:54 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:54 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf" returned: 0 in 1.021s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[91399c52-109f-4f6b-9ef5-32c9a7e87517]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:54 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:54 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:54 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 1.025s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:55 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:42:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Deleted volume successfully. Sep 25 13:42:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16fc8406-85ab-4fb8-8fb5-f77482e0c5d3 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-56dcf7a1-a265-495f-8ec7-f7f4ca925154-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:55 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.890s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:55 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf Sep 25 13:42:55 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Flow 'volume_create_manager' (c66b8d03-717a-4b23-b937-3040a15581ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:56 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4798a1-36ca-4be0-89ad-44c51f2e4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf" returned: 0 in 1.045s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:56 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf Sep 25 13:42:56 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4798a1-36ca-4be0-89ad-44c51f2e4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-805988353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24820e2-e218-46a1-9107-6c8166a2c090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='424a2dcada2b4383a2da521bc14fed68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:56Z,use_quota=True,user_id='b4ee6614db3f482691150462109803a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d8a65f-d380-4588-9766-bfa29c57a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d8a65f-d380-4588-9766-bfa29c57a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1430eb4e-0ff1-4df4-8d55-88a361e14ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1430eb4e-0ff1-4df4-8d55-88a361e14ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24820e2-e218-46a1-9107-6c8166a2c090', 'volume_name': 'volume-b24820e2-e218-46a1-9107-6c8166a2c090', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8debf8-03b3-4a42-9282-878bca1dc253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8debf8-03b3-4a42-9282-878bca1dc253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78853b2-bfa5-4ea5-9cb1-52e1be5aa492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:56 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Volume b24820e2-e218-46a1-9107-6c8166a2c090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24820e2-e218-46a1-9107-6c8166a2c090', 'volume_size': 1} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-805988353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24820e2-e218-46a1-9107-6c8166a2c090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='424a2dcada2b4383a2da521bc14fed68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:42:56Z,use_quota=True,user_id='b4ee6614db3f482691150462109803a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Creating volume b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:42:56 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:42:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:56 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 1073741824 Sep 25 13:42:56 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:57 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.1edcc9d4-494f-4c76-8eaf-e26d461880bf" returned: 0 in 0.525s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-1edcc9d4-494f-4c76-8eaf-e26d461880bf" released by "_delete_snapshot" :: held 3.720s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" released by "delete_snapshot" :: held 3.798s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Created reservations ['7173e4b6-a00a-4a2e-b3c4-f2fb0ea9bc95', 'be72ad21-a4cf-4a48-aa74-be63cf5aa4f1', 'a3375950-7daf-42f1-a81d-79c16444756a', '3ae4713a-94dc-44db-9ddc-b3588474f49d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:42:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Delete snapshot completed successfully. Sep 25 13:42:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5a1f77a-3bab-45ee-9654-e79319dfc747 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-1edcc9d4-494f-4c76-8eaf-e26d461880bf-delete_snapshot" released by "delete_snapshot" :: held 4.215s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:42:58 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 1073741824" returned: 0 in 1.254s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:58 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:42:58 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:42:58 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.362s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.222s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Creating offline snapshot 8bcb59e3-835b-4f07-88a4-3a638a3d014a of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78853b2-bfa5-4ea5-9cb1-52e1be5aa492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24820e2-e218-46a1-9107-6c8166a2c090', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44014542-dee1-49a0-a2ad-f71040308853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[567a7e73-3017-4d41-94db-5c0faf05cb90]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:58 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Volume volume-b24820e2-e218-46a1-9107-6c8166a2c090 (b24820e2-e218-46a1-9107-6c8166a2c090): created successfully Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44014542-dee1-49a0-a2ad-f71040308853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:42:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Flow 'volume_create_manager' (c66b8d03-717a-4b23-b937-3040a15581ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:42:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-30326c37-3b8c-42a1-9558-3676b0fd17c2 tempest-VolumesActionsTest-409083031 None] Created volume successfully. Sep 25 13:42:58 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:42:58 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:59 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.668s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:42:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:42:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:42:59 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a 1G Sep 25 13:42:59 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:42:59 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 25 13:42:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a 1G" returned: 0 in 0.648s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:00 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a Sep 25 13:43:00 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:00 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a" returned: 0 in 0.488s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:00 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a is being set with open permissions: ugo+rw Sep 25 13:43:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:00 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a Sep 25 13:43:00 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:01 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a" returned: 0 in 0.643s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4a3e2c2d-34b2-4223-9955-c04158415c48 tempest-SnapshotsActionsTest-373408164 None] Create snapshot completed successfully Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-8bcb59e3-835b-4f07-88a4-3a638a3d014a-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-8bcb59e3-835b-4f07-88a4-3a638a3d014a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-8bcb59e3-835b-4f07-88a4-3a638a3d014a" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (45e140fc-2404-4e83-baae-491fb63ea994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda2f2ad-50e2-443b-a1ba-d3f530d9dd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-8bcb59e3-835b-4f07-88a4-3a638a3d014a" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Deleting offline snapshot 8bcb59e3-835b-4f07-88a4-3a638a3d014a of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] snapshot_file for this snap is: volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda2f2ad-50e2-443b-a1ba-d3f530d9dd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1997657030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754f07ed-6a62-4389-a6ca-780d7ecafce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:02Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6049d965-f24d-4b2f-8e91-5b8020ccce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6049d965-f24d-4b2f-8e91-5b8020ccce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea5829d-3271-4cf9-bf94-b73f2bc9d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea5829d-3271-4cf9-bf94-b73f2bc9d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '754f07ed-6a62-4389-a6ca-780d7ecafce8', 'volume_name': 'volume-754f07ed-6a62-4389-a6ca-780d7ecafce8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4f8c88-abc7-4c7a-8b2a-88e84c099516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4f8c88-abc7-4c7a-8b2a-88e84c099516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3da1d2-b2a9-4966-b3b2-595621c1ca75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Volume 754f07ed-6a62-4389-a6ca-780d7ecafce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-754f07ed-6a62-4389-a6ca-780d7ecafce8', 'volume_size': 1} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1997657030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754f07ed-6a62-4389-a6ca-780d7ecafce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:02Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Creating volume 754f07ed-6a62-4389-a6ca-780d7ecafce8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:43:02 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5516ca56-7519-48c0-81c1-d8821ab9c173]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:02 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 1073741824 Sep 25 13:43:02 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:02 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a Sep 25 13:43:02 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:02 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a" returned: 0 in 0.705s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d46225-9237-4ada-999c-63b230284273]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:02 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 1073741824" returned: 0 in 0.844s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:03 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 Sep 25 13:43:03 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:03 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:43:03 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:03 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8" returned: 0 in 0.367s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3da1d2-b2a9-4966-b3b2-595621c1ca75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-754f07ed-6a62-4389-a6ca-780d7ecafce8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdc1613-0ad2-445b-a796-8d93302e08cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Volume volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 (754f07ed-6a62-4389-a6ca-780d7ecafce8): created successfully Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdc1613-0ad2-445b-a796-8d93302e08cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (45e140fc-2404-4e83-baae-491fb63ea994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3e67f61f-2693-4122-b217-c19a98736c7c tempest-VolumesActionsTest-1751990081 None] Created volume successfully. Sep 25 13:43:03 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.678s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:43:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:03 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a Sep 25 13:43:03 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-754f07ed-6a62-4389-a6ca-780d7ecafce8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Lock "cinder-754f07ed-6a62-4389-a6ca-780d7ecafce8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-quobyte-754f07ed-6a62-4389-a6ca-780d7ecafce8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-754f07ed-6a62-4389-a6ca-780d7ecafce8" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:04 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5590b7e3-9876-42ef-984d-97e806d9ae49]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a" returned: 0 in 0.906s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:04 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a Sep 25 13:43:04 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:04 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 Sep 25 13:43:04 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:04 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.8bcb59e3-835b-4f07-88a4-3a638a3d014a" returned: 0 in 0.433s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-8bcb59e3-835b-4f07-88a4-3a638a3d014a" released by "_delete_snapshot" :: held 3.033s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" released by "delete_snapshot" :: held 3.130s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Created reservations ['7937cb48-ac1c-4815-a263-ad1d0fa9cd1d', 'e679980c-3d18-4248-86f6-5d22897ef14e', 'a97f01bf-8851-4326-ad71-3c56b042a7fa', '53936e3a-79bd-4d58-b678-b0b6e93b394c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:05 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8" returned: 0 in 0.812s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Delete snapshot completed successfully. Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3700b160-b316-405a-8a0c-b796f9bcc450 tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-8bcb59e3-835b-4f07-88a4-3a638a3d014a-delete_snapshot" released by "delete_snapshot" :: held 3.512s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:05 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8 Sep 25 13:43:05 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:05 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-754f07ed-6a62-4389-a6ca-780d7ecafce8" returned: 0 in 0.363s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-754f07ed-6a62-4389-a6ca-780d7ecafce8" released by "delete_volume" :: held 1.253s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Created reservations ['2d4df77a-d179-46bc-b00c-fb67bec14fdb', '60170d95-35ac-4f67-965d-e82a4e889910', 'b50a6541-64ab-43a2-8ab0-e681a661204e', 'd9ae3d97-b2a0-4c70-b3a4-0665a2182dd0'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:05 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:05 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:06 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.316s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Deleted volume successfully. Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c61ed919-a0ac-4810-8a45-68dc45435c55 tempest-VolumesActionsTest-536508034 None] Lock "cinder-754f07ed-6a62-4389-a6ca-780d7ecafce8-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Creating offline snapshot 0c3b9640-804a-47ec-8626-c151a8f835f4 of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fe959d-6c10-4185-a2fe-d5fa5fd53e54]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:07 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:43:07 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:07 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.639s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:07 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 1G Sep 25 13:43:07 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (97866106-6287-4df5-b0e1-1e93848e30b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f06ae4b-7ebc-49b3-bb57-4d3c2f33b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f06ae4b-7ebc-49b3-bb57-4d3c2f33b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1138391427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70dcd96-8a07-40b3-9d8d-6d684f5954d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:08Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecb20dd-f96a-421a-9d25-342d68d4772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecb20dd-f96a-421a-9d25-342d68d4772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af37a2d5-1f4b-46de-9fc7-4cba40fbb6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af37a2d5-1f4b-46de-9fc7-4cba40fbb6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70dcd96-8a07-40b3-9d8d-6d684f5954d4', 'volume_name': 'volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3451af6-ba39-4243-b866-75d623cdc125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3451af6-ba39-4243-b866-75d623cdc125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dc9e25-af4c-4c40-9ea6-c83cff0a3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Volume d70dcd96-8a07-40b3-9d8d-6d684f5954d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4', 'volume_size': 1} Sep 25 13:43:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:08 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 1G" returned: 0 in 0.841s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:08 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 Sep 25 13:43:08 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:08 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4" returned: 0 in 0.521s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:08 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 is being set with open permissions: ugo+rw Sep 25 13:43:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:08 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 Sep 25 13:43:08 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:09 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4" returned: 0 in 0.586s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1138391427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70dcd96-8a07-40b3-9d8d-6d684f5954d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:08Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Creating volume d70dcd96-8a07-40b3-9d8d-6d684f5954d4 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:43:09 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:09 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 1073741824 Sep 25 13:43:09 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8e517b29-64e4-4e3f-a2d2-ec00ef1e8b58 tempest-SnapshotsActionsTest-373408164 None] Create snapshot completed successfully Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:09 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:09 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-0c3b9640-804a-47ec-8626-c151a8f835f4-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-0c3b9640-804a-47ec-8626-c151a8f835f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Acquiring lock "cinder-quobyte-0c3b9640-804a-47ec-8626-c151a8f835f4" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:10 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.334s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-0c3b9640-804a-47ec-8626-c151a8f835f4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Deleting offline snapshot 0c3b9640-804a-47ec-8626-c151a8f835f4 of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] snapshot_file for this snap is: volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a48ce-657f-43fa-9063-cd8301517708]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:10 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 1073741824" returned: 0 in 0.782s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:10 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 Sep 25 13:43:10 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:10 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 Sep 25 13:43:10 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:10 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4" returned: 0 in 0.297s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dc9e25-af4c-4c40-9ea6-c83cff0a3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760cb8f-42af-4b93-a2d8-7b49330284e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:10 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Volume volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 (d70dcd96-8a07-40b3-9d8d-6d684f5954d4): created successfully Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760cb8f-42af-4b93-a2d8-7b49330284e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (97866106-6287-4df5-b0e1-1e93848e30b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:10 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b91914de-31cd-4df8-aae8-912347cb6787 tempest-VolumesActionsTest-1751990081 None] Created volume successfully. Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4" returned: 0 in 0.484s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78602c8-ed4e-4f57-bce2-3dfe262516fc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:10 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:43:10 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-d70dcd96-8a07-40b3-9d8d-6d684f5954d4-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:11 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.523s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Lock "cinder-d70dcd96-8a07-40b3-9d8d-6d684f5954d4-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:11 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 Sep 25 13:43:11 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-quobyte-d70dcd96-8a07-40b3-9d8d-6d684f5954d4" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-d70dcd96-8a07-40b3-9d8d-6d684f5954d4" acquired by "delete_volume" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e4e6c-d897-4110-893a-f1e0ad321413]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:11 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 Sep 25 13:43:11 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:11 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4" returned: 0 in 0.556s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:11 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4 Sep 25 13:43:11 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:12 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4" returned: 0 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:12 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4 Sep 25 13:43:12 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:12 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.0c3b9640-804a-47ec-8626-c151a8f835f4" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-0c3b9640-804a-47ec-8626-c151a8f835f4" released by "_delete_snapshot" :: held 1.984s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" released by "delete_snapshot" :: held 2.018s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Created reservations ['ddf972f5-9b40-4ef4-954a-981c8213b622', 'af5f2e83-f152-4b83-a94a-c1cec14188d1', 'eb86a0ae-08a8-42cd-a79a-1638bf5dd041', '76bd75d6-8bf3-4915-bec7-f92ba2d82bce'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:12 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d70dcd96-8a07-40b3-9d8d-6d684f5954d4" returned: 0 in 0.336s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-d70dcd96-8a07-40b3-9d8d-6d684f5954d4" released by "delete_volume" :: held 0.874s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Delete snapshot completed successfully. Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3859cf1-b68b-4efc-bc5c-734ec779f3ce tempest-SnapshotsActionsTest-617035876 None] Lock "cinder-0c3b9640-804a-47ec-8626-c151a8f835f4-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Created reservations ['13250bbf-17e1-46f6-b3a5-aef01f2d3c5e', 'd6a85924-8d97-4311-964b-70ae7731a695', '6aa2efb7-8fc7-44e2-be4b-498a7d321b01', '86675f62-8771-41bc-8d5e-0a097837d216'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:12 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:12 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:12 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Deleted volume successfully. Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1f69ec2b-f2d2-4341-8ca4-942369560be5 tempest-VolumesActionsTest-536508034 None] Lock "cinder-d70dcd96-8a07-40b3-9d8d-6d684f5954d4-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3437d25-7141-4115-a6e0-59ba3db74591 tempest-VolumesActionsTest-409083031 None] Acquiring lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090" by "attach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3437d25-7141-4115-a6e0-59ba3db74591 tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090" acquired by "attach_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e3437d25-7141-4115-a6e0-59ba3db74591 tempest-VolumesActionsTest-409083031 None] Attaching volume b24820e2-e218-46a1-9107-6c8166a2c090 to instance 19aa6440-a2da-4025-a0c7-178b9d5bfddb at mountpoint /dev/vdb on host None. Sep 25 13:43:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e3437d25-7141-4115-a6e0-59ba3db74591 tempest-VolumesActionsTest-409083031 None] Attach volume completed successfully. Sep 25 13:43:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e3437d25-7141-4115-a6e0-59ba3db74591 tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090" released by "attach_volume" :: held 0.091s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9ed60b5-cf45-4f84-9087-043ece2f652e tempest-VolumesActionsTest-409083031 None] Acquiring lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-detach_volume" by "detach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9ed60b5-cf45-4f84-9087-043ece2f652e tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e9ed60b5-cf45-4f84-9087-043ece2f652e tempest-VolumesActionsTest-409083031 None] Detaching volume b24820e2-e218-46a1-9107-6c8166a2c090 from instance 19aa6440-a2da-4025-a0c7-178b9d5bfddb. Sep 25 13:43:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e9ed60b5-cf45-4f84-9087-043ece2f652e tempest-VolumesActionsTest-409083031 None] Detach volume completed successfully. Sep 25 13:43:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9ed60b5-cf45-4f84-9087-043ece2f652e tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "cinder-b8fc2dcc-6b77-43eb-958f-2a4caef9db77-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-b8fc2dcc-6b77-43eb-958f-2a4caef9db77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "cinder-quobyte-b8fc2dcc-6b77-43eb-958f-2a4caef9db77" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-quobyte-b8fc2dcc-6b77-43eb-958f-2a4caef9db77" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Deleting offline snapshot b8fc2dcc-6b77-43eb-958f-2a4caef9db77 of volume d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] snapshot_file for this snap is: volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3630601-b900-4329-b8fd-0d3d0b469488]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=95,cinder:SELECT=89,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=86,cinder:UPDATE=89,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:43:14 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:43:14 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (30b55869-0aa6-4a88-9143-faf673747008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e17d5af-d2aa-4c2f-9b2e-953965d2fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e17d5af-d2aa-4c2f-9b2e-953965d2fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213327571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe02f5e-738b-4011-8be4-b810f7df15e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:14Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b775402-95dd-4671-a134-f520ec89fb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b775402-95dd-4671-a134-f520ec89fb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bcf4f0-320a-4f04-94ab-22db50ea6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bcf4f0-320a-4f04-94ab-22db50ea6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe02f5e-738b-4011-8be4-b810f7df15e8', 'volume_name': 'volume-3fe02f5e-738b-4011-8be4-b810f7df15e8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc7ec32-920f-468d-8fba-05e31b45378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc7ec32-920f-468d-8fba-05e31b45378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0c6a3d-41e0-4cc1-ac3b-a33f1cfa688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Volume 3fe02f5e-738b-4011-8be4-b810f7df15e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe02f5e-738b-4011-8be4-b810f7df15e8', 'volume_size': 1} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213327571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe02f5e-738b-4011-8be4-b810f7df15e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:14Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Creating volume 3fe02f5e-738b-4011-8be4-b810f7df15e8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:43:14 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:14 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 1073741824 Sep 25 13:43:14 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:14 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.628s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d374071d-b251-4e06-90bf-6152405c6822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a78724-8fea-430d-8f9f-a7a4c588d1e8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:15 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 Sep 25 13:43:15 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:15 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 1073741824" returned: 0 in 0.767s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:15 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822" returned: 0 in 0.618s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:15 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:43:15 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:15 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 Sep 25 13:43:15 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:15 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8" returned: 0 in 0.363s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0c6a3d-41e0-4cc1-ac3b-a33f1cfa688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe02f5e-738b-4011-8be4-b810f7df15e8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93864cc1-ce3e-40a8-b73c-d03e26ddad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Volume volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 (3fe02f5e-738b-4011-8be4-b810f7df15e8): created successfully Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93864cc1-ce3e-40a8-b73c-d03e26ddad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (30b55869-0aa6-4a88-9143-faf673747008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-269b2ed3-d944-4455-9b78-e27ad6a302ea tempest-VolumesActionsTest-1751990081 None] Created volume successfully. Sep 25 13:43:16 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.503s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:16 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77 Sep 25 13:43:16 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:16 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822.b8fc2dcc-6b77-43eb-958f-2a4caef9db77" returned: 0 in 0.309s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-quobyte-b8fc2dcc-6b77-43eb-958f-2a4caef9db77" released by "_delete_snapshot" :: held 2.251s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" released by "delete_snapshot" :: held 2.281s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Created reservations ['06e9b0f2-8322-403c-9599-90da403872bd', '56aa0db2-56b5-4a31-9f4e-8ca3a7825a6d', '39271837-915f-47f2-ad7f-9504f2f8ed73', '467d06ad-e262-412e-a7e8-9a738ce0be1a'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Delete snapshot completed successfully. Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ff265bb4-a7e8-4ee8-97ae-d485a62dea9f tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-b8fc2dcc-6b77-43eb-958f-2a4caef9db77-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-3fe02f5e-738b-4011-8be4-b810f7df15e8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Lock "cinder-3fe02f5e-738b-4011-8be4-b810f7df15e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-quobyte-3fe02f5e-738b-4011-8be4-b810f7df15e8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-3fe02f5e-738b-4011-8be4-b810f7df15e8" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05d534-ed82-4f62-b7f7-66d4f5a3d603]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:17 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 Sep 25 13:43:17 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:17 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8" returned: 0 in 0.518s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:17 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8 Sep 25 13:43:17 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "cinder-d374071d-b251-4e06-90bf-6152405c6822-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-d374071d-b251-4e06-90bf-6152405c6822-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f6ab9-8f64-4929-934a-9d9b43510e60]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:17 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3fe02f5e-738b-4011-8be4-b810f7df15e8" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-3fe02f5e-738b-4011-8be4-b810f7df15e8" released by "delete_volume" :: held 0.995s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:17 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 Sep 25 13:43:17 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:17 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Created reservations ['75bf23bd-e6e3-431d-8394-03e3841aaa9a', 'c39d960e-0f43-4529-a1af-fedfdb6812cc', 'd5eb575a-6b49-4664-a2a2-413261761754', '3e06d296-b3d8-4071-bbe1-d69e32f79f70'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:18 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:18 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:18 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822" returned: 0 in 0.547s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:18 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822 Sep 25 13:43:18 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:18 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.316s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Deleted volume successfully. Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e872bb9c-de81-43a9-bf24-5a64acd97f4d tempest-VolumesActionsTest-536508034 None] Lock "cinder-3fe02f5e-738b-4011-8be4-b810f7df15e8-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:18 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d374071d-b251-4e06-90bf-6152405c6822" returned: 0 in 0.393s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-quobyte-d374071d-b251-4e06-90bf-6152405c6822" released by "delete_volume" :: held 1.075s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Created reservations ['f4d84bc8-6259-4967-beb7-b09ba4e57118', '247bd695-1db8-42ff-98be-c162aa88e7fa', 'e8aa8ef1-0141-4492-8191-484f32f08743', '3761581f-d77f-4969-8da6-7420f5837f52'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:18 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:18 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:19 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:19 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Deleted volume successfully. Sep 25 13:43:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1ed1bb1f-f63a-4496-b993-a2df9c6713ea tempest-SnapshotsActionsTest-373408164 None] Lock "cinder-d374071d-b251-4e06-90bf-6152405c6822-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (93dcb4be-7822-470f-b37a-1c13f83e5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd177fbb-4bf8-41a5-85fa-7dbc042fd02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd177fbb-4bf8-41a5-85fa-7dbc042fd02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441553538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:20Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fee51f9-23ec-4c50-b8a8-f11d3fdf512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fee51f9-23ec-4c50-b8a8-f11d3fdf512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae872d3e-0ef8-4f7c-a5ed-7f31af7090bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae872d3e-0ef8-4f7c-a5ed-7f31af7090bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d92b9a-26cb-43ff-84c6-c22ba6eebf4f', 'volume_name': 'volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bc20e6-bd5a-4ba7-9a30-9061cfdfc824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bc20e6-bd5a-4ba7-9a30-9061cfdfc824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18296e8-1590-4544-8ba9-0e0101f4abee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:20 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Volume d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f', 'volume_size': 1} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441553538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:20Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Creating volume d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:43:20 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:43:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:20 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f 1073741824 Sep 25 13:43:20 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:21 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f 1073741824" returned: 0 in 1.510s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:43:21 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f Sep 25 13:43:21 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Flow 'volume_create_manager' (bc9837c7-e49f-4c14-a361-6efe66786f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6470a43a-ff77-4b07-afd0-4de7f00737f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6470a43a-ff77-4b07-afd0-4de7f00737f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1245297956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86afff65-0b9c-4917-8a78-4582be67a101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c894ca5aeb1243c8970b261511179146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:22Z,use_quota=True,user_id='ff0b2cc9ae024de6a24a5de1c287c46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ba14b7-51f1-4a87-a7e0-cb3024a41eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ba14b7-51f1-4a87-a7e0-cb3024a41eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4dbe1a-0216-44c3-8fc8-4d962d85890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4dbe1a-0216-44c3-8fc8-4d962d85890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86afff65-0b9c-4917-8a78-4582be67a101', 'volume_name': 'volume-86afff65-0b9c-4917-8a78-4582be67a101', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2e10c6-9988-46ca-ba27-151d6fb01de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2e10c6-9988-46ca-ba27-151d6fb01de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454fc768-9c0b-4595-be3f-38d78a61f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Volume 86afff65-0b9c-4917-8a78-4582be67a101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86afff65-0b9c-4917-8a78-4582be67a101', 'volume_size': 1} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:22 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1245297956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86afff65-0b9c-4917-8a78-4582be67a101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c894ca5aeb1243c8970b261511179146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:22Z,use_quota=True,user_id='ff0b2cc9ae024de6a24a5de1c287c46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Creating volume 86afff65-0b9c-4917-8a78-4582be67a101 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:43:22 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18296e8-1590-4544-8ba9-0e0101f4abee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:22 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 1073741824 Sep 25 13:43:22 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499fe844-33ac-414f-9d98-7ab6209263bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Volume volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f (d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f): created successfully Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499fe844-33ac-414f-9d98-7ab6209263bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (93dcb4be-7822-470f-b37a-1c13f83e5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e0e0d21c-6169-41d7-8d07-d84a7d89b7ab tempest-VolumesActionsTest-1751990081 None] Created volume successfully. Sep 25 13:43:22 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 1073741824" returned: 0 in 0.589s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:22 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 Sep 25 13:43:22 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:23 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101" returned: 0 in 0.298s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454fc768-9c0b-4595-be3f-38d78a61f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86afff65-0b9c-4917-8a78-4582be67a101', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b7d4c4-7033-4dc5-a53f-842e054feb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:23 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Volume volume-86afff65-0b9c-4917-8a78-4582be67a101 (86afff65-0b9c-4917-8a78-4582be67a101): created successfully Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b7d4c4-7033-4dc5-a53f-842e054feb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Flow 'volume_create_manager' (bc9837c7-e49f-4c14-a361-6efe66786f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9fd2112f-eac7-4373-a18b-62f6ef60d65d tempest-AttachVolumeShelveTestJSON-267158340 None] Created volume successfully. Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Lock "cinder-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Acquiring lock "cinder-quobyte-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d1e31-9d5b-4559-b19b-c16eea7e825f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:24 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f Sep 25 13:43:24 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:24 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f" returned: 0 in 0.829s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:24 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f Sep 25 13:43:24 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:25 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f" returned: 0 in 0.552s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Lock "cinder-quobyte-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f" released by "delete_volume" :: held 1.472s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Created reservations ['e7042bb6-d6b3-40d7-8140-33bcd72c6f5f', 'c77f327b-bf90-4dc2-a08e-888785beaeed', '13d4e3bf-f8da-461b-afe9-067ca9b3d040', 'aa004a83-ac89-4e97-a36f-d5569308a9c4'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:25 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:25 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:25 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:25 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Deleted volume successfully. Sep 25 13:43:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8c89053d-258a-4999-afbd-a8ce27377dcf tempest-VolumesActionsTest-536508034 None] Lock "cinder-d4d92b9a-26cb-43ff-84c6-c22ba6eebf4f-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (9784564e-0afb-4101-9380-c08288d1a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3c5e76-1a61-4149-9bf9-1516b3460f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3c5e76-1a61-4149-9bf9-1516b3460f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1248646601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2073c4a7-5978-4b95-8538-f33895bd11f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:27Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dae9d3-b532-4fae-8be0-eb68ce2bfb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dae9d3-b532-4fae-8be0-eb68ce2bfb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87649bf6-d554-43d0-a9af-7e829f4d0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87649bf6-d554-43d0-a9af-7e829f4d0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2073c4a7-5978-4b95-8538-f33895bd11f3', 'volume_name': 'volume-2073c4a7-5978-4b95-8538-f33895bd11f3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad721474-c115-47e0-b462-1d52077d8a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad721474-c115-47e0-b462-1d52077d8a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc279f67-bc46-475c-9906-ff006ccf4c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:27 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Volume 2073c4a7-5978-4b95-8538-f33895bd11f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2073c4a7-5978-4b95-8538-f33895bd11f3', 'volume_size': 1} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1248646601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2073c4a7-5978-4b95-8538-f33895bd11f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d809fb76cb2c4141aa3ef8379c568f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:43:27Z,use_quota=True,user_id='c1a081e016824bd7aab87edb6c31af0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Creating volume 2073c4a7-5978-4b95-8538-f33895bd11f3 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:43:27 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:43:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:27 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 1073741824 Sep 25 13:43:27 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:28 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 1073741824" returned: 0 in 0.911s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:28 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 Sep 25 13:43:28 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:28 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3" returned: 0 in 0.431s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:43:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc279f67-bc46-475c-9906-ff006ccf4c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2073c4a7-5978-4b95-8538-f33895bd11f3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ff5877-50d5-42e5-a0d3-dd444a320ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:43:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Volume volume-2073c4a7-5978-4b95-8538-f33895bd11f3 (2073c4a7-5978-4b95-8538-f33895bd11f3): created successfully Sep 25 13:43:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ff5877-50d5-42e5-a0d3-dd444a320ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:43:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Flow 'volume_create_manager' (9784564e-0afb-4101-9380-c08288d1a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:43:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-423efbdf-288b-42b3-aa81-439d8a73e505 tempest-VolumesActionsTest-1751990081 None] Created volume successfully. Sep 25 13:43:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f2953cf0-174e-4dc6-8851-a83b2d53eba3 tempest-VolumesActionsTest-409083031 None] Acquiring lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090" by "attach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f2953cf0-174e-4dc6-8851-a83b2d53eba3 tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090" acquired by "attach_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f2953cf0-174e-4dc6-8851-a83b2d53eba3 tempest-VolumesActionsTest-409083031 None] Attaching volume b24820e2-e218-46a1-9107-6c8166a2c090 to instance 3d0a88b0-f184-4091-bc24-e88fc41c6de8 at mountpoint /dev/vdb on host None. Sep 25 13:43:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f2953cf0-174e-4dc6-8851-a83b2d53eba3 tempest-VolumesActionsTest-409083031 None] Attach volume completed successfully. Sep 25 13:43:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f2953cf0-174e-4dc6-8851-a83b2d53eba3 tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090" released by "attach_volume" :: held 0.140s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "cinder-2073c4a7-5978-4b95-8538-f33895bd11f3-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-2073c4a7-5978-4b95-8538-f33895bd11f3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "cinder-quobyte-2073c4a7-5978-4b95-8538-f33895bd11f3" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-quobyte-2073c4a7-5978-4b95-8538-f33895bd11f3" acquired by "delete_volume" :: waited 0.050s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[149cee0f-c74b-4c27-b4fb-21be1ed9cf80]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9348a386-66d6-4748-9bca-190af4b5f84b tempest-VolumesActionsTest-409083031 None] Acquiring lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-detach_volume" by "detach_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:43:31 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9348a386-66d6-4748-9bca-190af4b5f84b tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:43:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9348a386-66d6-4748-9bca-190af4b5f84b tempest-VolumesActionsTest-409083031 None] Detaching volume b24820e2-e218-46a1-9107-6c8166a2c090 from instance 3d0a88b0-f184-4091-bc24-e88fc41c6de8. Sep 25 13:43:31 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9348a386-66d6-4748-9bca-190af4b5f84b tempest-VolumesActionsTest-409083031 None] Detach volume completed successfully. Sep 25 13:43:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9348a386-66d6-4748-9bca-190af4b5f84b tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:32 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3" returned: 0 in 0.927s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:32 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3 Sep 25 13:43:32 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:32 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2073c4a7-5978-4b95-8538-f33895bd11f3" returned: 0 in 0.423s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-quobyte-2073c4a7-5978-4b95-8538-f33895bd11f3" released by "delete_volume" :: held 1.469s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Created reservations ['0f253190-ae10-4e6b-a368-4e62f6bd41e6', '94e0b97f-953a-4d62-bc10-17394c9d52f9', 'dd1a4d53-3605-4f63-979a-576103045420', 'cd3b1086-4893-4778-8adb-ebb9208f29d3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:43:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:32 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:43:32 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:33 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.571s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:33 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:43:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Deleted volume successfully. Sep 25 13:43:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a5211be4-d467-49a1-889e-25d5183e6b22 tempest-VolumesActionsTest-1751990081 None] Lock "cinder-2073c4a7-5978-4b95-8538-f33895bd11f3-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac1afa2-122e-4f38-a79e-1047ffc1cfba]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:38 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:43:38 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:38 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.542s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ecbae-1907-4820-8e42-a9cfd130e034]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:38 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:43:38 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:39 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.835s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.469fa3ed-6f05-4c08-a16a-3335212a80f3xas1x79t.img {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:39 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.469fa3ed-6f05-4c08-a16a-3335212a80f3xas1x79t.img Sep 25 13:43:39 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:43 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=37,cinder:UPDATE=51,cinder:DELETE=7,cinder:INSERT=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:43:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-87d45a97-32a0-4e16-b903-6ed2261a271e req-5577dc66-a567-4ea2-90d7-fb19570585b4 tempest-AttachVolumeShelveTestJSON-267158340 None] No connector for attachment 5739281c-85e0-49f8-951d-5e5833d88974; skipping storage backend terminate_connection call. {{(pid=87220) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 13:43:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-87d45a97-32a0-4e16-b903-6ed2261a271e req-5577dc66-a567-4ea2-90d7-fb19570585b4 tempest-AttachVolumeShelveTestJSON-267158340 None] Deleting attachment 5739281c-85e0-49f8-951d-5e5833d88974. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:43:50 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.469fa3ed-6f05-4c08-a16a-3335212a80f3xas1x79t.img" returned: 0 in 10.603s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c126c427-fee4-4276-92c2-1ad637c25bab]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:43:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:43:50 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:43:50 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:43:51 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 25 13:43:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.780s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:43:51 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090, size 1024.00 MB, duration 10.60 sec, destination /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.469fa3ed-6f05-4c08-a16a-3335212a80f3xas1x79t.img {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:43:51 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Converted 1024.00 MB image at 96.56 MB/s Sep 25 13:43:51 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] 469fa3ed-6f05-4c08-a16a-3335212a80f3 was raw, no need to convert to raw {{(pid=87220) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 13:43:54 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=44,cinder:UPDATE=53,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:44:01 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=3 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:44:02 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Flow 'volume_create_manager' (39b0ba06-78fb-4397-8742-cfaa6ee56e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1195138-50ce-42bd-81b5-9068507ad5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1195138-50ce-42bd-81b5-9068507ad5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-390627752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e89be1-8140-407a-812e-3eafd9caa5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b384ee030046b4bf83563ae5df672d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:03Z,use_quota=True,user_id='6cea7396e4cd4871b1d97f9c6d051b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f0a938-c54a-4a6c-9f09-ef0e3ebc4a8d),volume_type_id=f2f0a938-c54a-4a6c-9f09-ef0e3ebc4a8d)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10156a7c-16f0-4e4c-b9f8-8c6d70a41826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10156a7c-16f0-4e4c-b9f8-8c6d70a41826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f06b6d-ad8a-43a1-bc03-226113836bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f06b6d-ad8a-43a1-bc03-226113836bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e89be1-8140-407a-812e-3eafd9caa5de', 'volume_name': 'volume-00e89be1-8140-407a-812e-3eafd9caa5de', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a612cf-350c-414d-b5b7-4bfbaee30e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a612cf-350c-414d-b5b7-4bfbaee30e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816d080f-caff-4698-910b-f9bc06c1336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Volume 00e89be1-8140-407a-812e-3eafd9caa5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e89be1-8140-407a-812e-3eafd9caa5de', 'volume_size': 1} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Flow 'volume_create_manager' (09245e62-e6e1-4e50-8b1c-d63b876f79cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba980b0-3b04-4551-9587-c59a033b5629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba980b0-3b04-4551-9587-c59a033b5629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-971195243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cf44aa-c24d-493c-8d36-810882754e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b33e914f6f04a608ec148b4c189a9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:03Z,use_quota=True,user_id='979151677dc54a9fa2a5dfa96c4fdb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c035940d-d972-49da-800b-c1bfe019d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c035940d-d972-49da-800b-c1bfe019d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9ae813-400f-44f4-9a4b-f8e351595a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9ae813-400f-44f4-9a4b-f8e351595a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0cf44aa-c24d-493c-8d36-810882754e51', 'volume_name': 'volume-b0cf44aa-c24d-493c-8d36-810882754e51', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa0a47d-28b3-4074-98d3-271e8f39d340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa0a47d-28b3-4074-98d3-271e8f39d340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ef3bc-8833-4fe1-a0c3-d1e41dfcc269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Volume b0cf44aa-c24d-493c-8d36-810882754e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0cf44aa-c24d-493c-8d36-810882754e51', 'volume_size': 1} Sep 25 13:44:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:44:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:44:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:44:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=2 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:44:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=4 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.780s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Uploaded volume to glance image-id: 469fa3ed-6f05-4c08-a16a-3335212a80f3. {{(pid=87220) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.653s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-390627752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e89be1-8140-407a-812e-3eafd9caa5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b384ee030046b4bf83563ae5df672d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:03Z,use_quota=True,user_id='6cea7396e4cd4871b1d97f9c6d051b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f0a938-c54a-4a6c-9f09-ef0e3ebc4a8d),volume_type_id=f2f0a938-c54a-4a6c-9f09-ef0e3ebc4a8d)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Creating volume 00e89be1-8140-407a-812e-3eafd9caa5de {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:44:17 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:44:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:17 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de 1073741824 Sep 25 13:44:17 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c4c73a59-3577-4650-9115-bad84871e1d0 tempest-VolumesActionsTest-409083031 None] Copy volume to image completed successfully. Sep 25 13:44:18 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de 1073741824" returned: 0 in 0.686s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:18 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de Sep 25 13:44:18 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:18 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.106s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-971195243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cf44aa-c24d-493c-8d36-810882754e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b33e914f6f04a608ec148b4c189a9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:03Z,use_quota=True,user_id='979151677dc54a9fa2a5dfa96c4fdb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Creating volume b0cf44aa-c24d-493c-8d36-810882754e51 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:44:19 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816d080f-caff-4698-910b-f9bc06c1336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e89be1-8140-407a-812e-3eafd9caa5de', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:19 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 1073741824 Sep 25 13:44:19 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9f7467-185a-412c-92e0-e2bd62f71a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:19 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Volume volume-00e89be1-8140-407a-812e-3eafd9caa5de (00e89be1-8140-407a-812e-3eafd9caa5de): created successfully Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9f7467-185a-412c-92e0-e2bd62f71a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Flow 'volume_create_manager' (39b0ba06-78fb-4397-8742-cfaa6ee56e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a0c45033-7d68-4b93-aeac-a0052a433f44 tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Created volume successfully. Sep 25 13:44:19 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 1073741824" returned: 0 in 0.538s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:19 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 Sep 25 13:44:19 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:19 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51" returned: 0 in 0.331s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.213s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ef3bc-8833-4fe1-a0c3-d1e41dfcc269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0cf44aa-c24d-493c-8d36-810882754e51', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2a64b9-11a2-44b2-9de6-94186b49f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e5b654-19a4-4fa2-865e-8e6b904ae634]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:19 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Volume volume-b0cf44aa-c24d-493c-8d36-810882754e51 (b0cf44aa-c24d-493c-8d36-810882754e51): created successfully Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2a64b9-11a2-44b2-9de6-94186b49f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Flow 'volume_create_manager' (09245e62-e6e1-4e50-8b1c-d63b876f79cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0d2a14c4-67dd-4a99-bbf5-83559fae84b8 tempest-VolumesMetadataTest-729480857 None] Created volume successfully. Sep 25 13:44:20 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:44:20 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:20 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.574s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5270b9-b912-4a3f-a6e5-95409ae70fb6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:20 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:20 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:20 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:44:20 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:20 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.339s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b3e02420-e78f-4c8a-be77-77166ecc882f tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Retype volume completed successfully. Sep 25 13:44:21 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.562s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:21 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img Sep 25 13:44:21 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Acquiring lock "cinder-b0cf44aa-c24d-493c-8d36-810882754e51-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Lock "cinder-b0cf44aa-c24d-493c-8d36-810882754e51-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Acquiring lock "cinder-quobyte-b0cf44aa-c24d-493c-8d36-810882754e51" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Lock "cinder-quobyte-b0cf44aa-c24d-493c-8d36-810882754e51" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1363ae-575e-46a2-bd0b-d3c3129c7675]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:21 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 Sep 25 13:44:21 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:22 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51" returned: 0 in 0.964s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:22 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51 Sep 25 13:44:22 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:22 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b0cf44aa-c24d-493c-8d36-810882754e51" returned: 0 in 0.400s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Lock "cinder-quobyte-b0cf44aa-c24d-493c-8d36-810882754e51" released by "delete_volume" :: held 1.439s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Acquiring lock "cinder-00e89be1-8140-407a-812e-3eafd9caa5de-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "cinder-00e89be1-8140-407a-812e-3eafd9caa5de-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Created reservations ['a1651e30-7f05-445e-8879-75a0ce076a00', '1233032d-87fa-4db3-a24c-aef77f8ba0c9', 'fd4d1203-a983-4ef8-aeb2-02f9ce1a365e', '805b4e33-6370-453a-9137-57cba475fd35'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Acquiring lock "cinder-quobyte-00e89be1-8140-407a-812e-3eafd9caa5de" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "cinder-quobyte-00e89be1-8140-407a-812e-3eafd9caa5de" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a85fbb8-6ab0-4933-affd-a3f1b4e4082b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:23 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:23 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:23 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de Sep 25 13:44:23 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:24 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.692s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Deleted volume successfully. Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-94271ac5-2eb5-4127-98fe-38cf8c0343c6 tempest-VolumesMetadataTest-729480857 None] Lock "cinder-b0cf44aa-c24d-493c-8d36-810882754e51-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:24 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de" returned: 0 in 1.045s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:24 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de Sep 25 13:44:24 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:24 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-00e89be1-8140-407a-812e-3eafd9caa5de" returned: 0 in 0.642s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "cinder-quobyte-00e89be1-8140-407a-812e-3eafd9caa5de" released by "delete_volume" :: held 1.793s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:25 devstack cinder-volume[87220]: WARNING cinder.quota [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:44:25 devstack cinder-volume[87220]: WARNING cinder.quota [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Created reservations ['7a358c6f-4f75-4104-bf81-00bbf39d840d', 'eda6b84e-32a1-4f24-83b6-b4d9620008b9', '5aed28ff-03f7-454d-8b44-5f4f9e0643c7', '8297f154-86eb-41c5-b57c-0a30c25b216e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:25 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:25 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:25 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.570s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Deleted volume successfully. Sep 25 13:44:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a77e7378-696a-4e25-83d6-fba6b498cd3a tempest-VolumeRetypeWithoutMigrationTest-1733209579 None] Lock "cinder-00e89be1-8140-407a-812e-3eafd9caa5de-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:30 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img" returned: 0 in 8.985s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:30 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a05bf4-ee26-487e-b1f8-dd374a4b8eff]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:30 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:44:30 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:31 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.997s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:44:31 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Converted 1024.00 MB image at 113.96 MB/s Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] 0daadf57-c7fc-4d0f-b913-b549158768fa was raw, converting to qcow2 {{(pid=87220) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dd8469-09a6-4612-bb72-6e812ae39292]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:31 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img Sep 25 13:44:31 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:31 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img" returned: 0 in 0.515s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:31 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img Sep 25 13:44:31 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:32 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img" returned: 1 in 0.589s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img /opt/stack/data/cinder/conversion/vol_upload_avt06ibi {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:32 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img /opt/stack/data/cinder/conversion/vol_upload_avt06ibi Sep 25 13:44:32 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:32 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img /opt/stack/data/cinder/conversion/vol_upload_avt06ibi" returned: 0 in 0.490s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Image conversion details: src /opt/stack/data/cinder/conversion/b24820e2-e218-46a1-9107-6c8166a2c090.temp_image.0daadf57-c7fc-4d0f-b913-b549158768favcubb4u0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_avt06ibi {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:44:32 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[72808ad5-879c-44f9-ace9-992aa1e596d7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_avt06ibi {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:32 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_avt06ibi Sep 25 13:44:32 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:33 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_avt06ibi" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Flow 'volume_create_manager' (cf5e4aaf-ef6e-41d2-9cc8-4f934793ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344639b6-b101-49f5-9b57-3975adaf446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344639b6-b101-49f5-9b57-3975adaf446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-452677683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8892937e-05b5-4995-b210-1c4c4b040fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bef5fde03254649aeb37852184bd17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:33Z,use_quota=True,user_id='da86721c37e448979cfc94cf5b5364fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500c0320-d92c-4fc3-8cb8-0129a8ada0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500c0320-d92c-4fc3-8cb8-0129a8ada0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f51196-9f4e-42a1-a348-01a6f5ed89a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:33 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f51196-9f4e-42a1-a348-01a6f5ed89a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8892937e-05b5-4995-b210-1c4c4b040fcb', 'volume_name': 'volume-8892937e-05b5-4995-b210-1c4c4b040fcb', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c099c9f6-57d2-4850-8970-55c07898bc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c099c9f6-57d2-4850-8970-55c07898bc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854bc953-4641-457c-bce6-0304e359f040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:34 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Volume 8892937e-05b5-4995-b210-1c4c4b040fcb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8892937e-05b5-4995-b210-1c4c4b040fcb', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Trying to clone 8892937e-05b5-4995-b210-1c4c4b040fcb from image a1a28988-676d-4ae6-a228-f7c326723a56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:44:34 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Image download 20.69 MB at 20.69 MB/s Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c65c8a-fac5-4bd4-8865-ddce2a859557]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:34 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD Sep 25 13:44:34 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:35 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 is fetched for user da86721c37e448979cfc94cf5b5364fb. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dceeeea-1f65-45ef-98f6-4dbe0b4dcda7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Acquiring lock "cinder-86afff65-0b9c-4917-8a78-4582be67a101-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "cinder-86afff65-0b9c-4917-8a78-4582be67a101-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Acquiring lock "cinder-quobyte-86afff65-0b9c-4917-8a78-4582be67a101" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "cinder-quobyte-86afff65-0b9c-4917-8a78-4582be67a101" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:35 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD Sep 25 13:44:35 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f154b2ff-2650-441a-89fc-84c896a49789]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:35 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 Sep 25 13:44:35 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.740s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Uploaded volume to glance image-id: 0daadf57-c7fc-4d0f-b913-b549158768fa. {{(pid=87220) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 13:44:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fc8411e1-1d1c-4079-b7eb-4082b5c978b2 tempest-VolumesActionsTest-409083031 None] Copy volume to image completed successfully. Sep 25 13:44:35 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD" returned: 0 in 0.627s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-452677683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8892937e-05b5-4995-b210-1c4c4b040fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bef5fde03254649aeb37852184bd17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:33Z,use_quota=True,user_id='da86721c37e448979cfc94cf5b5364fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Creating volume 8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:44:35 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:35 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 1073741824 Sep 25 13:44:35 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:35 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101" returned: 0 in 0.531s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:36 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101 Sep 25 13:44:36 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:36 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-86afff65-0b9c-4917-8a78-4582be67a101" returned: 0 in 0.304s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "cinder-quobyte-86afff65-0b9c-4917-8a78-4582be67a101" released by "delete_volume" :: held 0.910s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Created reservations ['b57d7cc4-3e25-45ef-bc58-033720dd2cd2', 'ee5c9c12-72ae-4e52-a531-14345e77f7f3', '1cc082f8-38ec-49bd-8bd4-9759180fb9e8', 'cd4d2d5c-6524-4c38-8607-fd44637ad6fd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:36 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 1073741824" returned: 0 in 0.596s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:36 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:36 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:36 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb Sep 25 13:44:36 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:36 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.334s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Deleted volume successfully. Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0230ba66-459b-4472-98f8-730830863894 tempest-AttachVolumeShelveTestJSON-267158340 None] Lock "cinder-86afff65-0b9c-4917-8a78-4582be67a101-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:36 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:36 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Attempting download of a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume 8892937e-05b5-4995-b210-1c4c4b040fcb. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[84439315-e542-489c-841f-e90793266ece]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:37 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582 Sep 25 13:44:37 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:37 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:37 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582 Sep 25 13:44:37 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Acquiring lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Acquiring lock "cinder-quobyte-b24820e2-e218-46a1-9107-6c8166a2c090" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Lock "cinder-quobyte-b24820e2-e218-46a1-9107-6c8166a2c090" acquired by "delete_volume" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7a48c-82ad-4310-b5ef-20073adb5f6f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:38 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582" returned: 1 in 0.581s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_6_78s582' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3e712-a45d-4307-9983-4412ab8313c6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:38 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:44:38 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:38 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD Sep 25 13:44:38 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Flow 'volume_create_manager' (21d92a00-2c82-4786-8361-6ffadc085761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0939a4eb-e368-4154-9a4c-039a47d67a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0939a4eb-e368-4154-9a4c-039a47d67a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-800632624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512c5967-4233-434f-b90a-620d197f8ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480b3cab5a874f6cbc35be535027d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:38Z,use_quota=True,user_id='c765b304472a413495fc52e8ddfa5c6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0840c15d-c04d-47f7-a96d-460369434455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0840c15d-c04d-47f7-a96d-460369434455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838c5f08-f46e-4e65-88aa-34de55f80e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838c5f08-f46e-4e65-88aa-34de55f80e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512c5967-4233-434f-b90a-620d197f8ca6', 'volume_name': 'volume-512c5967-4233-434f-b90a-620d197f8ca6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db8cf42-c101-44ca-a466-757a7ce55015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db8cf42-c101-44ca-a466-757a7ce55015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0146fb98-ab86-446c-856a-a3e082bc63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:38 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Volume 512c5967-4233-434f-b90a-620d197f8ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512c5967-4233-434f-b90a-620d197f8ca6', 'volume_size': 1} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-800632624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512c5967-4233-434f-b90a-620d197f8ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480b3cab5a874f6cbc35be535027d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:38Z,use_quota=True,user_id='c765b304472a413495fc52e8ddfa5c6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Creating volume 512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:38 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:44:38 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] a1a28988-676d-4ae6-a228-f7c326723a56 was qcow2, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:38 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 1073741824 Sep 25 13:44:38 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:38 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb Sep 25 13:44:38 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:38 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.531s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:38 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090 Sep 25 13:44:38 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:38 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b24820e2-e218-46a1-9107-6c8166a2c090" returned: 0 in 0.376s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Lock "cinder-quobyte-b24820e2-e218-46a1-9107-6c8166a2c090" released by "delete_volume" :: held 0.990s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Created reservations ['1bab6e22-5ce1-47ac-b35b-2948bb941ee0', '96302d59-6aa6-491c-8445-7f3e4deb2b09', '848dfaba-07b1-483d-9760-a084c99804b6', 'd910be73-5ac0-4006-91ed-af066ff8a112'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:39 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 1073741824" returned: 0 in 0.740s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:39 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:39 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:39 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 Sep 25 13:44:39 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:39 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.348s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Deleted volume successfully. Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-91b73527-0840-4f64-b69a-837b3a0dfbbb tempest-VolumesActionsTest-409083031 None] Lock "cinder-b24820e2-e218-46a1-9107-6c8166a2c090-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:39 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0146fb98-ab86-446c-856a-a3e082bc63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512c5967-4233-434f-b90a-620d197f8ca6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784fc6e7-3407-48cc-9b80-a942f1fd403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:39 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Volume volume-512c5967-4233-434f-b90a-620d197f8ca6 (512c5967-4233-434f-b90a-620d197f8ca6): created successfully Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784fc6e7-3407-48cc-9b80-a942f1fd403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Flow 'volume_create_manager' (21d92a00-2c82-4786-8361-6ffadc085761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b8296be8-e477-475e-bc1a-5450751884ad tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Created volume successfully. Sep 25 13:44:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Creating offline snapshot 1bb4ae6d-c471-4f29-8a2d-aca4240839ca of volume 512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:44:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[140fb69c-222d-4b8a-8f81-9b7806558739]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:41 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 Sep 25 13:44:41 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:41 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb" returned: 0 in 2.838s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_t8yfdk4fdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:44:41 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Converted 112.00 MB image at 39.45 MB/s Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:41 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 1G Sep 25 13:44:41 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:41 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6" returned: 0 in 0.562s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:41 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca 1G Sep 25 13:44:41 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:41 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 1G" returned: 0 in 0.470s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Downloaded image a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume 8892937e-05b5-4995-b210-1c4c4b040fcb successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 for user da86721c37e448979cfc94cf5b5364fb is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Marking volume 8892937e-05b5-4995-b210-1c4c4b040fcb as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Copying metadata from image a1a28988-676d-4ae6-a228-f7c326723a56 to 8892937e-05b5-4995-b210-1c4c4b040fcb. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Creating volume glance metadata for volume 8892937e-05b5-4995-b210-1c4c4b040fcb backed by image a1a28988-676d-4ae6-a228-f7c326723a56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854bc953-4641-457c-bce6-0304e359f040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8892937e-05b5-4995-b210-1c4c4b040fcb', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab7b38f-5a08-48ea-bbfc-f7a631735ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Volume volume-8892937e-05b5-4995-b210-1c4c4b040fcb (8892937e-05b5-4995-b210-1c4c4b040fcb): created successfully Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab7b38f-5a08-48ea-bbfc-f7a631735ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Flow 'volume_create_manager' (cf5e4aaf-ef6e-41d2-9cc8-4f934793ad88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b8149ecf-629a-481b-873a-d42fbf5d30b2 tempest-VolumesExtendTest-1586407512 None] Created volume successfully. Sep 25 13:44:42 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca 1G" returned: 0 in 0.632s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-512c5967-4233-434f-b90a-620d197f8ca6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:42 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-512c5967-4233-434f-b90a-620d197f8ca6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca Sep 25 13:44:42 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:42 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-512c5967-4233-434f-b90a-620d197f8ca6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca" returned: 0 in 0.385s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:42 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca is being set with open permissions: ugo+rw Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:42 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca Sep 25 13:44:42 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:42 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca" returned: 0 in 0.305s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:42 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info Sep 25 13:44:42 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:43 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info" returned: 0 in 0.291s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:43 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info is being set with open permissions: ugo+rw Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:43 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info Sep 25 13:44:43 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:43 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.info" returned: 0 in 0.303s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.068s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f19cb99-a8ba-42e3-b33a-9d65919def04]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6edfab6d-647c-4ecf-aabd-de9412ab0ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Create snapshot completed successfully Sep 25 13:44:43 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb Sep 25 13:44:43 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:44 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb" returned: 0 in 0.627s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 2G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb 2G" returned: 0 in 0.151s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.827s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5f5f063d-99c2-4108-85cf-43e57d0b570a tempest-VolumesExtendTest-1586407512 None] Extend volume completed successfully. Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "cinder-1bb4ae6d-c471-4f29-8a2d-aca4240839ca-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-1bb4ae6d-c471-4f29-8a2d-aca4240839ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "cinder-quobyte-512c5967-4233-434f-b90a-620d197f8ca6" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-quobyte-512c5967-4233-434f-b90a-620d197f8ca6" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "cinder-quobyte-1bb4ae6d-c471-4f29-8a2d-aca4240839ca" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-quobyte-1bb4ae6d-c471-4f29-8a2d-aca4240839ca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Deleting offline snapshot 1bb4ae6d-c471-4f29-8a2d-aca4240839ca of volume 512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] snapshot_file for this snap is: volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d9b01-bfc3-4609-9334-7a5837530db0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:45 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca Sep 25 13:44:45 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-8892937e-05b5-4995-b210-1c4c4b040fcb-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Lock "cinder-8892937e-05b5-4995-b210-1c4c4b040fcb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-quobyte-8892937e-05b5-4995-b210-1c4c4b040fcb" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-8892937e-05b5-4995-b210-1c4c4b040fcb" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb389bd8-7604-4154-87a8-9c9565b1ecfd]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:45 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb Sep 25 13:44:45 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:45 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca" returned: 0 in 0.493s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-512c5967-4233-434f-b90a-620d197f8ca6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237c227-de48-4f5d-b95c-0275a51b3d7f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:45 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 Sep 25 13:44:45 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:45 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb" returned: 0 in 0.483s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:45 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb Sep 25 13:44:45 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:46 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6" returned: 0 in 0.617s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:46 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca Sep 25 13:44:46 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:46 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8892937e-05b5-4995-b210-1c4c4b040fcb" returned: 0 in 0.451s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-8892937e-05b5-4995-b210-1c4c4b040fcb" released by "delete_volume" :: held 1.001s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Created reservations ['49fd991b-cba6-40ca-92bd-4a5325a84bee', '86ae80b0-1f35-4672-a219-23d165e57975', '2f7f4cec-eaa7-4dfd-8252-d9c5ca27c979', 'a2c59210-891d-4b82-8927-352c03ebcc92'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:46 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:46 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:46 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca" returned: 0 in 0.562s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:46 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca Sep 25 13:44:46 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:46 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Deleted volume successfully. Sep 25 13:44:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-07c37aac-394e-44ba-ac9e-1659aafde74b tempest-VolumesExtendTest-1586407512 None] Lock "cinder-8892937e-05b5-4995-b210-1c4c4b040fcb-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:47 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6.1bb4ae6d-c471-4f29-8a2d-aca4240839ca" returned: 0 in 0.409s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-quobyte-1bb4ae6d-c471-4f29-8a2d-aca4240839ca" released by "_delete_snapshot" :: held 2.310s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-quobyte-512c5967-4233-434f-b90a-620d197f8ca6" released by "delete_snapshot" :: held 2.345s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:47 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Created reservations ['9bb4e546-0a1b-4370-87a7-7f4840fa43d6', '5b7b0213-2bab-473e-a39f-892b2dc79434', 'ea133a23-2c58-4bdf-85d5-e6719196edcc', '440188db-6a01-42ae-b2c2-0fdb07dccb72'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Delete snapshot completed successfully. Sep 25 13:44:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2110135d-96c5-48fa-bac4-2c610fa1ed1f tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-1bb4ae6d-c471-4f29-8a2d-aca4240839ca-delete_snapshot" released by "delete_snapshot" :: held 2.616s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Flow 'volume_create_manager' (d417e2c9-0ac6-48ec-99d0-721e78524fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2021d5-7f35-496d-903a-a928c0270d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "cinder-512c5967-4233-434f-b90a-620d197f8ca6-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2021d5-7f35-496d-903a-a928c0270d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-799439094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e79855-9a86-4a87-b79c-b4b464116f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bef5fde03254649aeb37852184bd17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:48Z,use_quota=True,user_id='da86721c37e448979cfc94cf5b5364fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d27e56-8485-4c3e-ae2f-d6221ed6668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d27e56-8485-4c3e-ae2f-d6221ed6668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99ed12a-a66d-42f7-9f32-f4fdc5e58c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99ed12a-a66d-42f7-9f32-f4fdc5e58c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e79855-9a86-4a87-b79c-b4b464116f8d', 'volume_name': 'volume-95e79855-9a86-4a87-b79c-b4b464116f8d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15916596-745c-4ce9-9ba8-ccd21106e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15916596-745c-4ce9-9ba8-ccd21106e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96042729-4b68-45f9-8df0-4662eafb700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Volume 95e79855-9a86-4a87-b79c-b4b464116f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e79855-9a86-4a87-b79c-b4b464116f8d', 'volume_size': 1} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-799439094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e79855-9a86-4a87-b79c-b4b464116f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bef5fde03254649aeb37852184bd17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:48Z,use_quota=True,user_id='da86721c37e448979cfc94cf5b5364fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Creating volume 95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:44:48 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-512c5967-4233-434f-b90a-620d197f8ca6-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:48 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d 1073741824 Sep 25 13:44:48 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "cinder-quobyte-512c5967-4233-434f-b90a-620d197f8ca6" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-quobyte-512c5967-4233-434f-b90a-620d197f8ca6" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75fbfe7-6587-49fa-b614-cf954e71e080]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:48 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 Sep 25 13:44:48 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:48 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d 1073741824" returned: 0 in 0.674s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:49 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d Sep 25 13:44:49 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:49 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6" returned: 0 in 0.688s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:49 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6 Sep 25 13:44:49 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:49 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d" returned: 0 in 0.422s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96042729-4b68-45f9-8df0-4662eafb700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e79855-9a86-4a87-b79c-b4b464116f8d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bd62ef-facb-41fa-b981-027a6ba654a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:49 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Volume volume-95e79855-9a86-4a87-b79c-b4b464116f8d (95e79855-9a86-4a87-b79c-b4b464116f8d): created successfully Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bd62ef-facb-41fa-b981-027a6ba654a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Flow 'volume_create_manager' (d417e2c9-0ac6-48ec-99d0-721e78524fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b298a457-ba91-4dbf-8231-d114ce8c060d tempest-VolumesExtendTest-1586407512 None] Created volume successfully. Sep 25 13:44:49 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-512c5967-4233-434f-b90a-620d197f8ca6" returned: 0 in 0.443s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-quobyte-512c5967-4233-434f-b90a-620d197f8ca6" released by "delete_volume" :: held 1.239s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Created reservations ['e0733a4f-0e39-40d8-8239-89c9d37abf10', 'e60c53ee-9d8d-4beb-9641-7992e81b2d8b', 'fa95791b-3f40-4e32-82c7-cb50b8bb8f9f', '655efcff-8e18-4173-a73d-87aa2319fdef'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:49 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:49 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:50 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.318s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Deleted volume successfully. Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a1733327-51a2-4466-97d7-eadcd87bccc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-29762527 None] Lock "cinder-512c5967-4233-434f-b90a-620d197f8ca6-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Creating offline snapshot 481ea1e0-c307-4f7d-8b61-774d6995a91b of volume 95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc51a8a6-9ccc-488d-8044-eda865bf997e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:51 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d Sep 25 13:44:51 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:51 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d" returned: 0 in 0.532s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:51 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b 1G Sep 25 13:44:51 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:52 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b 1G" returned: 0 in 0.610s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e79855-9a86-4a87-b79c-b4b464116f8d -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:52 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e79855-9a86-4a87-b79c-b4b464116f8d -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b Sep 25 13:44:52 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:52 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e79855-9a86-4a87-b79c-b4b464116f8d -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b" returned: 0 in 0.498s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:52 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b is being set with open permissions: ugo+rw Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:52 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b Sep 25 13:44:52 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Flow 'volume_create_manager' (33101fe2-2047-4533-aa31-84ea19ef06d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f2e92f-5263-4562-b6db-cca85cb1f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f2e92f-5263-4562-b6db-cca85cb1f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-224915405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0680691-12ce-42ff-8f09-97b4d8c19021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21db69ba02141f086cc26dd6a3dfd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:53Z,use_quota=True,user_id='b4f277fd089044518b1605b7caadbb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5feee801-a608-4c01-87c3-b6d4fafb5a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5feee801-a608-4c01-87c3-b6d4fafb5a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383f220-cfce-438d-a865-d3a43701b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383f220-cfce-438d-a865-d3a43701b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0680691-12ce-42ff-8f09-97b4d8c19021', 'volume_name': 'volume-a0680691-12ce-42ff-8f09-97b4d8c19021', 'volume_size': 2}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1ddb5b-bb17-4333-aa39-daf53c7ec2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1ddb5b-bb17-4333-aa39-daf53c7ec2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46dfc68-4631-4918-b35b-092d4eba6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:52 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Volume a0680691-12ce-42ff-8f09-97b4d8c19021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0680691-12ce-42ff-8f09-97b4d8c19021', 'volume_size': 2} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:52 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b" returned: 0 in 0.400s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:53 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info Sep 25 13:44:53 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:53 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:53 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info is being set with open permissions: ugo+rw Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:53 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info Sep 25 13:44:53 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:53 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.info" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.914s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-224915405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0680691-12ce-42ff-8f09-97b4d8c19021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21db69ba02141f086cc26dd6a3dfd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:44:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:44:53Z,use_quota=True,user_id='b4f277fd089044518b1605b7caadbb66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Creating volume a0680691-12ce-42ff-8f09-97b4d8c19021 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:44:53 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:44:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 2147483648 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:53 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 2147483648 Sep 25 13:44:53 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:53 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-081d0afb-3dca-4afe-846e-1a13f769e2d6 tempest-VolumesExtendTest-1586407512 None] Create snapshot completed successfully Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:54 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 2147483648" returned: 0 in 0.795s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:54 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 Sep 25 13:44:54 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:54 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021" returned: 0 in 0.379s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.761s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46dfc68-4631-4918-b35b-092d4eba6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0680691-12ce-42ff-8f09-97b4d8c19021', 'volume_size': 2}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6aafb1c-0165-4b42-b308-a4328023d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef88f5-a0d4-4583-ad0c-535fcb9c9efa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:55 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Volume volume-a0680691-12ce-42ff-8f09-97b4d8c19021 (a0680691-12ce-42ff-8f09-97b4d8c19021): created successfully Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6aafb1c-0165-4b42-b308-a4328023d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Flow 'volume_create_manager' (33101fe2-2047-4533-aa31-84ea19ef06d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:44:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-633813c4-be2b-4b7a-bc1d-c9d3c52dbee7 tempest-VolumesCloneNegativeTest-2092173095 None] Created volume successfully. Sep 25 13:44:55 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d Sep 25 13:44:55 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:55 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d" returned: 0 in 0.524s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b 2G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b 2G" returned: 0 in 0.270s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.867s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5e4557b8-b4f0-4b23-bd71-662f83eb7694 tempest-VolumesExtendTest-1586407512 None] Extend volume completed successfully. Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Acquiring lock "cinder-a0680691-12ce-42ff-8f09-97b4d8c19021-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "cinder-a0680691-12ce-42ff-8f09-97b4d8c19021-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Acquiring lock "cinder-quobyte-a0680691-12ce-42ff-8f09-97b4d8c19021" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "cinder-quobyte-a0680691-12ce-42ff-8f09-97b4d8c19021" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ca643-594d-44db-ab81-81c65a3307f8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-481ea1e0-c307-4f7d-8b61-774d6995a91b-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:56 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 Sep 25 13:44:56 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Lock "cinder-481ea1e0-c307-4f7d-8b61-774d6995a91b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-quobyte-95e79855-9a86-4a87-b79c-b4b464116f8d" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-95e79855-9a86-4a87-b79c-b4b464116f8d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-quobyte-481ea1e0-c307-4f7d-8b61-774d6995a91b" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-481ea1e0-c307-4f7d-8b61-774d6995a91b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Deleting offline snapshot 481ea1e0-c307-4f7d-8b61-774d6995a91b of volume 95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] snapshot_file for this snap is: volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1465fea6-0f9d-4ae1-8048-e2cb34f8dc40]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:56 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b Sep 25 13:44:56 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:57 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021" returned: 0 in 0.715s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:57 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021 Sep 25 13:44:57 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:57 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b" returned: 0 in 0.618s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95e79855-9a86-4a87-b79c-b4b464116f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b61a68-796a-40f6-bbad-f216fd536920]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:57 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a0680691-12ce-42ff-8f09-97b4d8c19021" returned: 0 in 0.527s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:57 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d Sep 25 13:44:57 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "cinder-quobyte-a0680691-12ce-42ff-8f09-97b4d8c19021" released by "delete_volume" :: held 1.335s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Created reservations ['70f107e0-26ea-4a49-a29e-210a10fabe39', '9e18c613-e9d8-402b-be8a-119fdeac943c', '48b739b4-8e44-482d-8162-77606c32929a', 'fba9045a-b6dc-415e-bdb2-c946cc8a6f4b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:44:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:58 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:44:58 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:58 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d" returned: 0 in 0.619s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:58 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b Sep 25 13:44:58 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:58 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.353s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:44:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Deleted volume successfully. Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51489d56-8acd-471f-a440-13c2e77dde02 tempest-VolumesCloneNegativeTest-2092173095 None] Lock "cinder-a0680691-12ce-42ff-8f09-97b4d8c19021-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:58 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b" returned: 0 in 0.600s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:44:58 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b Sep 25 13:44:58 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:44:59 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 25 13:44:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d.481ea1e0-c307-4f7d-8b61-774d6995a91b" returned: 0 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:44:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-481ea1e0-c307-4f7d-8b61-774d6995a91b" released by "_delete_snapshot" :: held 2.492s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-95e79855-9a86-4a87-b79c-b4b464116f8d" released by "delete_snapshot" :: held 2.539s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:44:59 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Created reservations ['efe808f7-02ed-4681-8e76-7bb98ab71910', '65a86d27-ff9e-45f9-a2a0-d00adc8729a7', '71e8e048-20e0-4a50-bee5-4ffa6bcd8cad', '2b4b6f77-a91c-441b-867a-317d82f97801'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:44:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Delete snapshot completed successfully. Sep 25 13:44:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-866274bd-2cac-4586-af16-9345126844fa tempest-VolumesExtendTest-1586407512 None] Lock "cinder-481ea1e0-c307-4f7d-8b61-774d6995a91b-delete_snapshot" released by "delete_snapshot" :: held 2.788s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-95e79855-9a86-4a87-b79c-b4b464116f8d-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Lock "cinder-95e79855-9a86-4a87-b79c-b4b464116f8d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Acquiring lock "cinder-quobyte-95e79855-9a86-4a87-b79c-b4b464116f8d" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-95e79855-9a86-4a87-b79c-b4b464116f8d" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5e774-81d1-4888-9bb9-166240294669]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:00 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d Sep 25 13:45:00 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:00 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d" returned: 0 in 0.464s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:00 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d Sep 25 13:45:00 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:01 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-95e79855-9a86-4a87-b79c-b4b464116f8d" returned: 0 in 0.340s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Lock "cinder-quobyte-95e79855-9a86-4a87-b79c-b4b464116f8d" released by "delete_volume" :: held 0.913s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Created reservations ['3792189e-87b8-4280-bf8e-f4bf2c9b0c50', 'ac6468d1-dddd-42c3-bba3-187604204b47', '9f6c079b-1844-4267-b597-7b0577673a37', '28b3277e-9532-49a0-8b0a-e01d4c1ac3e6'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:01 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:01 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:01 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.370s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Deleted volume successfully. Sep 25 13:45:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20e5f914-68bd-4ff1-b064-1fa4bd51965f tempest-VolumesExtendTest-1586407512 None] Lock "cinder-95e79855-9a86-4a87-b79c-b4b464116f8d-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Flow 'volume_create_manager' (38185fe9-b556-49d6-9260-cb2bfe4e726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146edf33-dfc1-478b-a763-66d563f60e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146edf33-dfc1-478b-a763-66d563f60e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-194345608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c26410-4f7a-445c-b66e-2df65fc2bb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a3e1b010444a35bc843bff12e75972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:08Z,use_quota=True,user_id='5bdedd4fd8374f49b9a3960a19404190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13318bbe-af71-4c63-b73b-dcb240d1a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13318bbe-af71-4c63-b73b-dcb240d1a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2ed547-ca79-45b8-ae6b-84df60c7b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2ed547-ca79-45b8-ae6b-84df60c7b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c26410-4f7a-445c-b66e-2df65fc2bb21', 'volume_name': 'volume-48c26410-4f7a-445c-b66e-2df65fc2bb21', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf72a81-e38f-4064-a389-e78e04cce37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf72a81-e38f-4064-a389-e78e04cce37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9829b6-9973-4a5b-87e5-7956b8ec527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Volume 48c26410-4f7a-445c-b66e-2df65fc2bb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c26410-4f7a-445c-b66e-2df65fc2bb21', 'volume_size': 1} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-194345608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c26410-4f7a-445c-b66e-2df65fc2bb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a3e1b010444a35bc843bff12e75972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:08Z,use_quota=True,user_id='5bdedd4fd8374f49b9a3960a19404190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Creating volume 48c26410-4f7a-445c-b66e-2df65fc2bb21 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:07 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:07 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 1073741824 Sep 25 13:45:07 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:08 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 1073741824" returned: 0 in 0.655s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:08 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 Sep 25 13:45:08 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:08 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9829b6-9973-4a5b-87e5-7956b8ec527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c26410-4f7a-445c-b66e-2df65fc2bb21', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e60f8f-80fe-4cb7-969b-5e28cfea1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Volume volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 (48c26410-4f7a-445c-b66e-2df65fc2bb21): created successfully Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e60f8f-80fe-4cb7-969b-5e28cfea1e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Flow 'volume_create_manager' (38185fe9-b556-49d6-9260-cb2bfe4e726e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4da62438-4103-4bdf-b1b8-8799b9844f4c tempest-AbsoluteLimitsTests-353903143 None] Created volume successfully. Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:09 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:09 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Flow 'volume_create_manager' (5b65dace-215c-40d8-a3fa-5a351b568fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1b9c18-9ccd-4df5-856a-9befc9cac319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1b9c18-9ccd-4df5-856a-9befc9cac319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1677810365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f73aba-515e-44d9-90d3-de478e6f3113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bf89166fd40929b6fef8f3f1c9103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:10Z,use_quota=True,user_id='008646010f044c48b1956a5029ee7d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde09ec1-bb52-482b-94db-523a811c4ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde09ec1-bb52-482b-94db-523a811c4ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2712dfc-8a23-4e18-a5fb-3a141d7972e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2712dfc-8a23-4e18-a5fb-3a141d7972e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f73aba-515e-44d9-90d3-de478e6f3113', 'volume_name': 'volume-b5f73aba-515e-44d9-90d3-de478e6f3113', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990897cc-4ca5-40da-b64c-6df8a7d3223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990897cc-4ca5-40da-b64c-6df8a7d3223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a503c799-66ed-416c-a47b-ca1baff6864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:10 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Volume b5f73aba-515e-44d9-90d3-de478e6f3113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f73aba-515e-44d9-90d3-de478e6f3113', 'volume_size': 1} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1677810365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f73aba-515e-44d9-90d3-de478e6f3113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bf89166fd40929b6fef8f3f1c9103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:10Z,use_quota=True,user_id='008646010f044c48b1956a5029ee7d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Creating volume b5f73aba-515e-44d9-90d3-de478e6f3113 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:10 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Acquiring lock "cinder-48c26410-4f7a-445c-b66e-2df65fc2bb21-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Lock "cinder-48c26410-4f7a-445c-b66e-2df65fc2bb21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:10 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 1073741824 Sep 25 13:45:10 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Acquiring lock "cinder-quobyte-48c26410-4f7a-445c-b66e-2df65fc2bb21" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:10 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Lock "cinder-quobyte-48c26410-4f7a-445c-b66e-2df65fc2bb21" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.513s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fed684-8e12-4043-913a-6e91d26bb94d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:10 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 Sep 25 13:45:10 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:10 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 1073741824" returned: 0 in 0.725s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:11 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 Sep 25 13:45:11 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:11 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21" returned: 0 in 0.685s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:11 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21 Sep 25 13:45:11 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:11 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a503c799-66ed-416c-a47b-ca1baff6864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f73aba-515e-44d9-90d3-de478e6f3113', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1042eac8-3cec-4a63-8d12-f66ceef0ac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Volume volume-b5f73aba-515e-44d9-90d3-de478e6f3113 (b5f73aba-515e-44d9-90d3-de478e6f3113): created successfully Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1042eac8-3cec-4a63-8d12-f66ceef0ac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Flow 'volume_create_manager' (5b65dace-215c-40d8-a3fa-5a351b568fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:11 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2b849dcd-5070-43a5-b8ba-5a9bd4c8901c tempest-VolumesNegativeTest-2054254668 None] Created volume successfully. Sep 25 13:45:11 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-48c26410-4f7a-445c-b66e-2df65fc2bb21" returned: 0 in 0.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Lock "cinder-quobyte-48c26410-4f7a-445c-b66e-2df65fc2bb21" released by "delete_volume" :: held 1.124s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Created reservations ['84f64cbd-61d8-4136-94c0-9e9574f02074', 'c241fe86-4d88-4648-a16a-edf6f08945ac', '056e5a16-0612-454a-b9a4-c0842ad2bc45', 'abb44eab-c9ec-4c1e-b328-659a0025513f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:11 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:11 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:12 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.313s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Deleted volume successfully. Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-abd74215-9a16-41f8-9189-090a0e01d675 tempest-AbsoluteLimitsTests-353903143 None] Lock "cinder-48c26410-4f7a-445c-b66e-2df65fc2bb21-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (edcef48d-fd20-4896-9d2b-52d92ccb2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba5eb32-d751-4afd-b155-4accbd31c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba5eb32-d751-4afd-b155-4accbd31c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624317880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823c45e4-b90d-478e-bd74-9b65035af1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:12Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1dbde97-22e6-4b0d-ad72-955037efb777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1dbde97-22e6-4b0d-ad72-955037efb777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85369670-7bc6-469a-b72e-667835d8aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85369670-7bc6-469a-b72e-667835d8aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823c45e4-b90d-478e-bd74-9b65035af1b7', 'volume_name': 'volume-823c45e4-b90d-478e-bd74-9b65035af1b7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91b3168-d713-4d99-8f8e-16fb3f2a2f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91b3168-d713-4d99-8f8e-16fb3f2a2f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff71d2b-adc7-4d2b-9681-a394a22e0509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume 823c45e4-b90d-478e-bd74-9b65035af1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823c45e4-b90d-478e-bd74-9b65035af1b7', 'volume_size': 1} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624317880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823c45e4-b90d-478e-bd74-9b65035af1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:12Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating volume 823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:12 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:12 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 1073741824 Sep 25 13:45:12 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:13 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 1073741824" returned: 0 in 0.896s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=106,cinder:UPDATE=119,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:45:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:13 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 Sep 25 13:45:13 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:14 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7" returned: 0 in 0.464s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=93,cinder:UPDATE=128,cinder:DELETE=12,cinder:INSERT=40 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff71d2b-adc7-4d2b-9681-a394a22e0509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823c45e4-b90d-478e-bd74-9b65035af1b7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd51472-a9be-4641-8f30-62b598e9b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume volume-823c45e4-b90d-478e-bd74-9b65035af1b7 (823c45e4-b90d-478e-bd74-9b65035af1b7): created successfully Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd51472-a9be-4641-8f30-62b598e9b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (edcef48d-fd20-4896-9d2b-52d92ccb2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8f262d90-fb16-46f5-b017-a46825916dad tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created volume successfully. Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating offline snapshot a4ef6557-9382-4bdb-8040-0c5eb6e68893 of volume 823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8404a2c-b7c5-450d-8a0d-76ea7ed8b0b7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:15 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 Sep 25 13:45:15 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:15 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7" returned: 0 in 0.710s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:15 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 1G Sep 25 13:45:15 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:16 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 1G" returned: 0 in 0.664s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823c45e4-b90d-478e-bd74-9b65035af1b7 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:16 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823c45e4-b90d-478e-bd74-9b65035af1b7 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 Sep 25 13:45:16 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:17 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823c45e4-b90d-478e-bd74-9b65035af1b7 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893" returned: 0 in 0.595s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:17 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 is being set with open permissions: ugo+rw Sep 25 13:45:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:17 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 Sep 25 13:45:17 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:17 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893" returned: 0 in 0.369s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:17 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info Sep 25 13:45:17 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:17 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info" returned: 0 in 0.350s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:17 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info is being set with open permissions: ugo+rw Sep 25 13:45:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:17 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info Sep 25 13:45:17 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:18 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.info" returned: 0 in 0.309s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.151s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c822d205-12d7-4dd4-acaa-559e1bb0b782 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Create snapshot completed successfully Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (60f68b53-941f-42cc-805d-f6845444683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fc6562-3714-4e79-a0a5-e44d9521ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fc6562-3714-4e79-a0a5-e44d9521ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847750284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b9b09-8c26-4637-9016-f488b2e3fe1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:20Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5468df-501b-4367-b0cc-0799bcbf7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5468df-501b-4367-b0cc-0799bcbf7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e97778-9a6a-49ba-9e05-1da8c11c7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e97778-9a6a-49ba-9e05-1da8c11c7322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06b9b09-8c26-4637-9016-f488b2e3fe1a', 'volume_name': 'volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd4c367-2057-4d01-9720-1562a8525a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd4c367-2057-4d01-9720-1562a8525a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20081508-a79c-472c-b4cf-65017b8369b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:20 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume d06b9b09-8c26-4637-9016-f488b2e3fe1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a', 'volume_size': 1} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847750284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b9b09-8c26-4637-9016-f488b2e3fe1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:20Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating volume d06b9b09-8c26-4637-9016-f488b2e3fe1a {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:20 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:20 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a 1073741824 Sep 25 13:45:20 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (69d658f4-3e4b-4a3c-b66f-797988bd0e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a9cd33-29c5-4e3f-9695-701b673fd5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a9cd33-29c5-4e3f-9695-701b673fd5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21789553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09315554-ebb2-4d37-a808-15e5251ffd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:21Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e170efb-b065-479d-b5c1-023af050ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e170efb-b065-479d-b5c1-023af050ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce7301f-8753-43d8-a974-552ed211d3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce7301f-8753-43d8-a974-552ed211d3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09315554-ebb2-4d37-a808-15e5251ffd35', 'volume_name': 'volume-09315554-ebb2-4d37-a808-15e5251ffd35', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f0bc7e-c16c-4623-a475-dc26bc935f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f0bc7e-c16c-4623-a475-dc26bc935f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c149380-3c9b-4502-a63e-6454e83a028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:21 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume 09315554-ebb2-4d37-a808-15e5251ffd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09315554-ebb2-4d37-a808-15e5251ffd35', 'volume_size': 1} Sep 25 13:45:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:22 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a 1073741824" returned: 0 in 1.287s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:22 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a Sep 25 13:45:22 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (304bbff5-471c-4944-b698-4a4fef5e1fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634ac6e2-cf06-455f-8d24-10ee607ce00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634ac6e2-cf06-455f-8d24-10ee607ce00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135077345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a151a3-da1a-447b-8382-a8f7ad07be69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:22Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bba460c-d565-49b0-8b1a-f4694295778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bba460c-d565-49b0-8b1a-f4694295778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff19e5f-1cb9-411c-94a3-80b5d884eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff19e5f-1cb9-411c-94a3-80b5d884eede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a151a3-da1a-447b-8382-a8f7ad07be69', 'volume_name': 'volume-10a151a3-da1a-447b-8382-a8f7ad07be69', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17c854a-8b60-4610-b6e9-f0e97eb45dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17c854a-8b60-4610-b6e9-f0e97eb45dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487f3030-e287-465a-b0dd-4a9aba569123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume 10a151a3-da1a-447b-8382-a8f7ad07be69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a151a3-da1a-447b-8382-a8f7ad07be69', 'volume_size': 1} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:22 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a" returned: 0 in 0.618s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21789553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09315554-ebb2-4d37-a808-15e5251ffd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:21Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating volume 09315554-ebb2-4d37-a808-15e5251ffd35 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:22 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:23 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 1073741824 Sep 25 13:45:23 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20081508-a79c-472c-b4cf-65017b8369b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89de1c3-6894-4e0b-bea0-b046861a9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:23 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a (d06b9b09-8c26-4637-9016-f488b2e3fe1a): created successfully Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89de1c3-6894-4e0b-bea0-b046861a9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (60f68b53-941f-42cc-805d-f6845444683f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f05cb69a-e30a-4d00-aa78-7c7b9ee7ffb4 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created volume successfully. Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (5551dba6-fab4-4507-8282-7d79a8723056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd47585b-d168-40b4-be85-9da4ea905b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:24 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd47585b-d168-40b4-be85-9da4ea905b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835991071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac61333-3e47-47da-982c-07bdf121e036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:24Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2be05d-8438-4b77-97f8-7adf6184ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2be05d-8438-4b77-97f8-7adf6184ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9403a5bc-f0a3-4b39-b303-ab8df7c7ae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9403a5bc-f0a3-4b39-b303-ab8df7c7ae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac61333-3e47-47da-982c-07bdf121e036', 'volume_name': 'volume-8ac61333-3e47-47da-982c-07bdf121e036', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573b13c-9484-45fe-a1a1-5fe19a6cd183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573b13c-9484-45fe-a1a1-5fe19a6cd183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d308b09-9d01-4521-aaf4-3135dc351220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:24 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume 8ac61333-3e47-47da-982c-07bdf121e036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac61333-3e47-47da-982c-07bdf121e036', 'volume_size': 1} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 1073741824" returned: 0 in 1.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:24 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 Sep 25 13:45:24 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (629fe271-c303-4088-836d-f8b17f66818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:25 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6037083b-940b-4b7d-a720-1c86942006cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35" returned: 0 in 0.840s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] <== create_volume: return (2535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.565s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135077345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a151a3-da1a-447b-8382-a8f7ad07be69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:22Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating volume 10a151a3-da1a-447b-8382-a8f7ad07be69 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:25 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:25 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 1073741824 Sep 25 13:45:25 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c149380-3c9b-4502-a63e-6454e83a028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09315554-ebb2-4d37-a808-15e5251ffd35', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb81728a-1c83-480a-a457-ea1c61bc067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6037083b-940b-4b7d-a720-1c86942006cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020269435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a82ad28-071c-414f-9853-3f9420eddb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:25Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c632a-e5af-486b-bccd-0cf10f214853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c632a-e5af-486b-bccd-0cf10f214853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cd85e1-a960-4cce-80b0-11493c1c3dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cd85e1-a960-4cce-80b0-11493c1c3dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a82ad28-071c-414f-9853-3f9420eddb21', 'volume_name': 'volume-3a82ad28-071c-414f-9853-3f9420eddb21', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6deb20a-c95d-421c-abc0-e0dd05f29923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6deb20a-c95d-421c-abc0-e0dd05f29923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904ca971-1816-498a-aded-c86352459f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:26 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume 3a82ad28-071c-414f-9853-3f9420eddb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a82ad28-071c-414f-9853-3f9420eddb21', 'volume_size': 1} Sep 25 13:45:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:26 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume volume-09315554-ebb2-4d37-a808-15e5251ffd35 (09315554-ebb2-4d37-a808-15e5251ffd35): created successfully Sep 25 13:45:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb81728a-1c83-480a-a457-ea1c61bc067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (69d658f4-3e4b-4a3c-b66f-797988bd0e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-14c7c448-a0c4-4d9c-8380-6ede53826e71 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created volume successfully. Sep 25 13:45:27 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 1073741824" returned: 0 in 1.675s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:27 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 Sep 25 13:45:27 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:27 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69" returned: 0 in 0.544s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835991071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac61333-3e47-47da-982c-07bdf121e036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:24Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating volume 8ac61333-3e47-47da-982c-07bdf121e036 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:27 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:27 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 1073741824 Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487f3030-e287-465a-b0dd-4a9aba569123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a151a3-da1a-447b-8382-a8f7ad07be69', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:27 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb295a7-1131-4a46-a869-64a28c7a438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume volume-10a151a3-da1a-447b-8382-a8f7ad07be69 (10a151a3-da1a-447b-8382-a8f7ad07be69): created successfully Sep 25 13:45:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb295a7-1131-4a46-a869-64a28c7a438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (304bbff5-471c-4944-b698-4a4fef5e1fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f2237f1f-2a3c-4b20-8806-1b7ca66077d5 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created volume successfully. Sep 25 13:45:28 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 1073741824" returned: 0 in 0.818s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:28 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 Sep 25 13:45:28 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:29 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036" returned: 0 in 0.542s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.356s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020269435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a82ad28-071c-414f-9853-3f9420eddb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1c40f571724361a64240e7437687ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:25Z,use_quota=True,user_id='b5273192fe69433f9f8581274cadcf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Creating volume 3a82ad28-071c-414f-9853-3f9420eddb21 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:29 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d308b09-9d01-4521-aaf4-3135dc351220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac61333-3e47-47da-982c-07bdf121e036', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965e0862-89bc-471a-b088-7fcc69c7c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume volume-8ac61333-3e47-47da-982c-07bdf121e036 (8ac61333-3e47-47da-982c-07bdf121e036): created successfully Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965e0862-89bc-471a-b088-7fcc69c7c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (5551dba6-fab4-4507-8282-7d79a8723056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:29 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 1073741824 Sep 25 13:45:29 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b74f1858-b9df-40fe-ada5-f05e2489be88 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created volume successfully. Sep 25 13:45:30 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 1073741824" returned: 0 in 1.312s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:31 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 Sep 25 13:45:31 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Flow 'volume_create_manager' (aad8014d-82c8-4104-b463-194eee923808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a28d62-afde-4f25-ad06-a1815600b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a28d62-afde-4f25-ad06-a1815600b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-178453207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c9e92-4789-4c5d-8260-530a3a947746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb56a876e234c889ca0236da4f968d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:31Z,use_quota=True,user_id='9ab5641e6e4c419bb6bfecb49d25ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b95d9aa-3b5a-48aa-aafa-1701c62165e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b95d9aa-3b5a-48aa-aafa-1701c62165e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3cca26-5e9d-4d1a-9c3f-e22809ffd538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3cca26-5e9d-4d1a-9c3f-e22809ffd538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73c9e92-4789-4c5d-8260-530a3a947746', 'volume_name': 'volume-c73c9e92-4789-4c5d-8260-530a3a947746', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc39fa47-45e0-4fbc-be73-17b73eda4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc39fa47-45e0-4fbc-be73-17b73eda4b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a99d88-e918-4530-9a94-59d592e8e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:31 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Volume c73c9e92-4789-4c5d-8260-530a3a947746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73c9e92-4789-4c5d-8260-530a3a947746', 'volume_size': 1} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:31 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21" returned: 0 in 0.817s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] <== create_volume: return (2361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.372s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.245s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-178453207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c9e92-4789-4c5d-8260-530a3a947746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb56a876e234c889ca0236da4f968d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:31Z,use_quota=True,user_id='9ab5641e6e4c419bb6bfecb49d25ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Creating volume c73c9e92-4789-4c5d-8260-530a3a947746 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:31 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:31 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 1073741824 Sep 25 13:45:31 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904ca971-1816-498a-aded-c86352459f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a82ad28-071c-414f-9853-3f9420eddb21', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6845c186-2b35-4433-a4cd-83d2ae12fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:31 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Volume volume-3a82ad28-071c-414f-9853-3f9420eddb21 (3a82ad28-071c-414f-9853-3f9420eddb21): created successfully Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6845c186-2b35-4433-a4cd-83d2ae12fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Flow 'volume_create_manager' (629fe271-c303-4088-836d-f8b17f66818c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d67225dc-327c-4954-9069-52850aecd6d3 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created volume successfully. Sep 25 13:45:32 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 1073741824" returned: 0 in 0.905s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:32 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 Sep 25 13:45:32 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-3a82ad28-071c-414f-9853-3f9420eddb21-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-3a82ad28-071c-414f-9853-3f9420eddb21-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-3a82ad28-071c-414f-9853-3f9420eddb21" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-3a82ad28-071c-414f-9853-3f9420eddb21" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:33 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746" returned: 0 in 0.689s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a99d88-e918-4530-9a94-59d592e8e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73c9e92-4789-4c5d-8260-530a3a947746', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d7c80e-551f-4f3e-b55e-04e194b53d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc7c72-9a46-420c-af9a-a78073c37d92]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:33 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Volume volume-c73c9e92-4789-4c5d-8260-530a3a947746 (c73c9e92-4789-4c5d-8260-530a3a947746): created successfully Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d7c80e-551f-4f3e-b55e-04e194b53d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Flow 'volume_create_manager' (aad8014d-82c8-4104-b463-194eee923808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-095ac2d0-90f2-4b29-b603-b972fd1d6e72 tempest-VolumesTransfersTest-1084905611 None] Created volume successfully. Sep 25 13:45:33 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 Sep 25 13:45:33 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:34 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21" returned: 0 in 0.694s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:34 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21 Sep 25 13:45:34 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:34 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3a82ad28-071c-414f-9853-3f9420eddb21" returned: 0 in 0.439s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-3a82ad28-071c-414f-9853-3f9420eddb21" released by "delete_volume" :: held 1.220s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['cbfc290b-78e4-460a-b259-474b4fbec25f', '2fe21db0-cb16-4a45-bf84-8e9ad7597799', 'efb89d74-f298-4931-9bd9-3e7896420ea5', '5e2c4fc9-76cb-470f-8709-fec91958494b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:34 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:34 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:35 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.368s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleted volume successfully. Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9b7dfa0-5f56-43cb-8d73-56f3baad1023 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-3a82ad28-071c-414f-9853-3f9420eddb21-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-8ac61333-3e47-47da-982c-07bdf121e036-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-8ac61333-3e47-47da-982c-07bdf121e036-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-8ac61333-3e47-47da-982c-07bdf121e036" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-8ac61333-3e47-47da-982c-07bdf121e036" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e519b-7b0a-4294-9524-b47f8e726660]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:36 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 Sep 25 13:45:36 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5c1e57f3-bc4b-4e19-99ce-2ff407dd34c0 tempest-VolumesTransfersTest-2006674891 None] Transfer volume completed successfully. Sep 25 13:45:36 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036" returned: 0 in 0.501s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:36 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036 Sep 25 13:45:36 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:36 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8ac61333-3e47-47da-982c-07bdf121e036" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-8ac61333-3e47-47da-982c-07bdf121e036" released by "delete_volume" :: held 1.034s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['e5d894bf-77b0-4e04-ab79-fe622a3623e1', '21faf25e-4a15-4ab9-bd49-f3b0f00a9537', 'be923824-d631-47ba-aa9d-80e64c5e27a4', 'dbe1fee8-b5ef-43bd-9221-f487563cb090'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:37 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:37 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Acquiring lock "cinder-c73c9e92-4789-4c5d-8260-530a3a947746-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-c73c9e92-4789-4c5d-8260-530a3a947746-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:37 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.293s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleted volume successfully. Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-eb890dd3-975e-4f8e-9e45-b2624c29c4dc tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-8ac61333-3e47-47da-982c-07bdf121e036-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Acquiring lock "cinder-quobyte-c73c9e92-4789-4c5d-8260-530a3a947746" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-quobyte-c73c9e92-4789-4c5d-8260-530a3a947746" acquired by "delete_volume" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d8a74-0950-47aa-835a-765fc5bc6583]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:37 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 Sep 25 13:45:37 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:38 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746" returned: 0 in 0.501s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:38 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746 Sep 25 13:45:38 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-10a151a3-da1a-447b-8382-a8f7ad07be69-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-10a151a3-da1a-447b-8382-a8f7ad07be69-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-10a151a3-da1a-447b-8382-a8f7ad07be69" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-10a151a3-da1a-447b-8382-a8f7ad07be69" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[202c9fa0-6d57-4c75-82a9-977f472f109d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:38 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 Sep 25 13:45:38 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:38 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c73c9e92-4789-4c5d-8260-530a3a947746" returned: 0 in 0.492s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-quobyte-c73c9e92-4789-4c5d-8260-530a3a947746" released by "delete_volume" :: held 1.062s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Created reservations ['f8b75633-5a2c-4bac-83ac-8e3a3448816d', '05e87c20-e89b-4983-9f7c-73d0d6665fbd', 'e9c7d82f-5400-4e51-b291-7baea15b9e92', '44cfa034-8faf-4539-8d2e-2a39f1280384'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:38 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:38 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:38 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69" returned: 0 in 0.616s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:38 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69 Sep 25 13:45:38 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:39 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.328s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Deleted volume successfully. Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7550a584-809a-4273-88eb-834cb40fc7ac tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-c73c9e92-4789-4c5d-8260-530a3a947746-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:39 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-10a151a3-da1a-447b-8382-a8f7ad07be69" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-10a151a3-da1a-447b-8382-a8f7ad07be69" released by "delete_volume" :: held 0.990s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['3b83caca-0fa9-4cab-a275-74ed0fafa503', '5cba55a3-e10f-4338-b570-0309c410b1bc', '1e93fec5-1413-489c-b357-7087002f8fbf', '26f84745-e38d-4edf-a858-de46fff6a480'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:39 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:39 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:39 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.283s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleted volume successfully. Sep 25 13:45:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-89df7b45-f438-45ed-bd4c-4398eec53a00 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-10a151a3-da1a-447b-8382-a8f7ad07be69-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Flow 'volume_create_manager' (f1e34046-3426-4a88-9e53-e065e1ab4516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b328431-6fd5-4ede-808e-c548614231c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b328431-6fd5-4ede-808e-c548614231c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1983213173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e352b00-0625-4d19-beb8-cba8571b2e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb56a876e234c889ca0236da4f968d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:40Z,use_quota=True,user_id='9ab5641e6e4c419bb6bfecb49d25ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38b6c92-b9d2-42ac-8bf3-dabd69e0cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38b6c92-b9d2-42ac-8bf3-dabd69e0cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b9c73e-7521-4c12-9f1a-f4bb5db61ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b9c73e-7521-4c12-9f1a-f4bb5db61ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e352b00-0625-4d19-beb8-cba8571b2e2d', 'volume_name': 'volume-1e352b00-0625-4d19-beb8-cba8571b2e2d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4932300-ccaf-460a-8328-08c7171bce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4932300-ccaf-460a-8328-08c7171bce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99d1118-d946-4d80-b34a-ab82e2180ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Volume 1e352b00-0625-4d19-beb8-cba8571b2e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e352b00-0625-4d19-beb8-cba8571b2e2d', 'volume_size': 1} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1983213173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e352b00-0625-4d19-beb8-cba8571b2e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb56a876e234c889ca0236da4f968d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:40Z,use_quota=True,user_id='9ab5641e6e4c419bb6bfecb49d25ec99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Creating volume 1e352b00-0625-4d19-beb8-cba8571b2e2d {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:40 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:40 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d 1073741824 Sep 25 13:45:40 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-09315554-ebb2-4d37-a808-15e5251ffd35-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-09315554-ebb2-4d37-a808-15e5251ffd35-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-09315554-ebb2-4d37-a808-15e5251ffd35" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-09315554-ebb2-4d37-a808-15e5251ffd35" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a2d2ab-b4ac-4f80-82f5-530efd004ae6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:40 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 Sep 25 13:45:40 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:41 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d 1073741824" returned: 0 in 0.642s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:41 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d Sep 25 13:45:41 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:41 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35" returned: 0 in 0.522s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:41 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35 Sep 25 13:45:41 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:41 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d" returned: 0 in 0.338s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99d1118-d946-4d80-b34a-ab82e2180ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e352b00-0625-4d19-beb8-cba8571b2e2d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8818eb-d4dd-4245-9bad-5e51cc3af8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Volume volume-1e352b00-0625-4d19-beb8-cba8571b2e2d (1e352b00-0625-4d19-beb8-cba8571b2e2d): created successfully Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8818eb-d4dd-4245-9bad-5e51cc3af8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Flow 'volume_create_manager' (f1e34046-3426-4a88-9e53-e065e1ab4516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:41 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8a2cec43-6f12-4ca6-84f7-9a89e8cbadde tempest-VolumesTransfersTest-1084905611 None] Created volume successfully. Sep 25 13:45:41 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09315554-ebb2-4d37-a808-15e5251ffd35" returned: 0 in 0.375s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-09315554-ebb2-4d37-a808-15e5251ffd35" released by "delete_volume" :: held 0.954s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['828164d7-3b1c-4576-9fb8-32ae27395bb5', '42bc68f2-ac3e-4dfa-a995-0be5ad2a0f5e', '91cb97ac-eb86-4f11-a7d3-8778daccbfe9', 'd0a9ae5a-1f66-49a7-aa11-92dbc59c1bd5'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:41 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:41 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:42 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleted volume successfully. Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b82a16b0-b384-43ae-bcda-d9fdc2c0bcf2 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-09315554-ebb2-4d37-a808-15e5251ffd35-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Acquiring lock "cinder-1e352b00-0625-4d19-beb8-cba8571b2e2d-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-1e352b00-0625-4d19-beb8-cba8571b2e2d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-d06b9b09-8c26-4637-9016-f488b2e3fe1a-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-d06b9b09-8c26-4637-9016-f488b2e3fe1a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Acquiring lock "cinder-quobyte-1e352b00-0625-4d19-beb8-cba8571b2e2d" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-quobyte-1e352b00-0625-4d19-beb8-cba8571b2e2d" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-d06b9b09-8c26-4637-9016-f488b2e3fe1a" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c503a-20f6-43d1-ae3f-672ac554866c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-d06b9b09-8c26-4637-9016-f488b2e3fe1a" acquired by "delete_volume" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[11137eb4-5673-4e7b-9b31-4415d96d811b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:43 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d Sep 25 13:45:43 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:43 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a Sep 25 13:45:43 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:43 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d" returned: 0 in 0.521s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:43 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d Sep 25 13:45:43 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:43 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a" returned: 0 in 0.544s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:43 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a Sep 25 13:45:43 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:43 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e352b00-0625-4d19-beb8-cba8571b2e2d" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-quobyte-1e352b00-0625-4d19-beb8-cba8571b2e2d" released by "delete_volume" :: held 0.944s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:43 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d06b9b09-8c26-4637-9016-f488b2e3fe1a" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-d06b9b09-8c26-4637-9016-f488b2e3fe1a" released by "delete_volume" :: held 0.987s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Created reservations ['e0c17cbe-7c76-4855-937a-42940ee2033a', 'd871e08a-605c-48f4-b3f3-931a3af24d39', '0bab8b70-9be3-4843-920d-df0d92863e45', '5091338e-bf68-4a40-921c-f1c10a3738f8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['228415ed-064e-4b72-9807-65669d1ea5b9', '9e4b6887-7d3c-4a7e-9a05-2f500bbd9136', '6ffa33b0-b403-4d4f-835f-91b3ad38e055', '0cfb5ff5-e354-4a08-a59a-cc3d1a1ed16e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:44 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:44 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:44 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:44 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:44 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.294s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Deleted volume successfully. Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1a92fb4b-5863-423c-bb1f-5ec00ee3949b tempest-VolumesTransfersTest-1395708955 None] Lock "cinder-1e352b00-0625-4d19-beb8-cba8571b2e2d-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:44 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.345s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleted volume successfully. Sep 25 13:45:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-17ff980d-f170-4e97-b00e-813ec7668b56 tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-d06b9b09-8c26-4637-9016-f488b2e3fe1a-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-a4ef6557-9382-4bdb-8040-0c5eb6e68893-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-a4ef6557-9382-4bdb-8040-0c5eb6e68893-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-823c45e4-b90d-478e-bd74-9b65035af1b7" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-823c45e4-b90d-478e-bd74-9b65035af1b7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-a4ef6557-9382-4bdb-8040-0c5eb6e68893" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-a4ef6557-9382-4bdb-8040-0c5eb6e68893" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleting offline snapshot a4ef6557-9382-4bdb-8040-0c5eb6e68893 of volume 823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] snapshot_file for this snap is: volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3803e02e-26dd-4039-af00-9e40159b8975]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:45 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 Sep 25 13:45:45 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:45 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893" returned: 0 in 0.638s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-823c45e4-b90d-478e-bd74-9b65035af1b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[27379f72-1bcc-401b-8ca7-77b9da6fd2fa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Acquiring lock "cinder-b5f73aba-515e-44d9-90d3-de478e6f3113-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Lock "cinder-b5f73aba-515e-44d9-90d3-de478e6f3113-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Acquiring lock "cinder-quobyte-b5f73aba-515e-44d9-90d3-de478e6f3113" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Lock "cinder-quobyte-b5f73aba-515e-44d9-90d3-de478e6f3113" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1a851-764f-4653-860c-0879653899d1]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:46 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 Sep 25 13:45:46 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:46 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 Sep 25 13:45:46 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:46 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7" returned: 0 in 0.635s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:46 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 Sep 25 13:45:46 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:46 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113" returned: 0 in 0.561s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:46 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113 Sep 25 13:45:46 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:47 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893" returned: 0 in 0.435s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:47 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b5f73aba-515e-44d9-90d3-de478e6f3113" returned: 0 in 0.353s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:47 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893 Sep 25 13:45:47 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Lock "cinder-quobyte-b5f73aba-515e-44d9-90d3-de478e6f3113" released by "delete_volume" :: held 0.990s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Created reservations ['4f4e7757-cc71-46ac-8b77-33959f93fca0', '205d1b44-546f-4a91-a581-2624e2a269f1', '9c157577-58df-428b-a00b-8185c35a9ad5', '21536d83-ce3b-4833-9c67-281cca28785d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:47 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:47 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:47 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7.a4ef6557-9382-4bdb-8040-0c5eb6e68893" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-a4ef6557-9382-4bdb-8040-0c5eb6e68893" released by "_delete_snapshot" :: held 2.292s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-823c45e4-b90d-478e-bd74-9b65035af1b7" released by "delete_snapshot" :: held 2.320s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['20e75fa4-5fb6-40e4-b0e2-64276f95ecb6', 'd558585c-ce9e-422a-bccd-6aa102ce22f2', '88cc15f9-1307-479a-91ab-3028081940fa', 'c2869857-fe0f-4d50-b0c9-f850b06828cf'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Delete snapshot completed successfully. Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-915dfe7d-8103-476c-88a4-6e9f1de2f82a tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-a4ef6557-9382-4bdb-8040-0c5eb6e68893-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:47 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Deleted volume successfully. Sep 25 13:45:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b18ec5a-c730-4cc8-8c26-15bfc0c8ccef tempest-VolumesNegativeTest-2054254668 None] Lock "cinder-b5f73aba-515e-44d9-90d3-de478e6f3113-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-823c45e4-b90d-478e-bd74-9b65035af1b7-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-823c45e4-b90d-478e-bd74-9b65035af1b7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "cinder-quobyte-823c45e4-b90d-478e-bd74-9b65035af1b7" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:45:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-823c45e4-b90d-478e-bd74-9b65035af1b7" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:45:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fa1325-713a-4ef8-b925-2cf397c35019]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:45:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:48 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 Sep 25 13:45:48 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:49 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7" returned: 0 in 0.495s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:49 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7 Sep 25 13:45:49 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:49 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-823c45e4-b90d-478e-bd74-9b65035af1b7" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-quobyte-823c45e4-b90d-478e-bd74-9b65035af1b7" released by "delete_volume" :: held 0.901s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Created reservations ['b6b6b6b3-90ce-4944-b495-a70285103efd', 'fd657ea6-f98e-44dd-a6b7-4abad503f055', '1d567b7e-b1c6-4789-818d-f6dd16a13d06', '3b6d226c-8b78-4315-8103-36ec6259dcd9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:49 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:45:49 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:50 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.399s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:50 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:45:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Deleted volume successfully. Sep 25 13:45:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7294bb1f-9cb4-40d5-98c7-14659431455f tempest-CreateVolumesFromSnapshotTest-1708156637 None] Lock "cinder-823c45e4-b90d-478e-bd74-9b65035af1b7-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Flow 'volume_create_manager' (d71cb477-5406-43a1-b9a3-1fe0f1eb6fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d41e02-2cfc-4691-80ad-d78a256ef90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d41e02-2cfc-4691-80ad-d78a256ef90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1100683333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13749f31ea748f09f175386dfaafc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:53Z,use_quota=True,user_id='4ee945e5f9be48599611197db96a63e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10314c28-9a71-47e1-8188-1b1bbffd43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10314c28-9a71-47e1-8188-1b1bbffd43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2549df-8194-4cef-9d8e-0311e1dd9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2549df-8194-4cef-9d8e-0311e1dd9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7', 'volume_name': 'volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e821c6f-1a4d-43c8-8f6a-07b4870b4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e821c6f-1a4d-43c8-8f6a-07b4870b4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a3fb9f-1fa8-4177-bf1c-8503c52a353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:53 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Volume 4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7', 'volume_size': 1} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1100683333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13749f31ea748f09f175386dfaafc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:53Z,use_quota=True,user_id='4ee945e5f9be48599611197db96a63e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Creating volume 4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:53 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:53 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 1073741824 Sep 25 13:45:53 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:53 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 1073741824" returned: 0 in 0.691s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:54 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 Sep 25 13:45:54 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:54 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a3fb9f-1fa8-4177-bf1c-8503c52a353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14013b1-629c-4027-b179-df5e4bf6cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:54 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Volume volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 (4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7): created successfully Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14013b1-629c-4027-b179-df5e4bf6cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Flow 'volume_create_manager' (d71cb477-5406-43a1-b9a3-1fe0f1eb6fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-350ce4ce-6140-47f7-a5e6-6c26e5aa963b tempest-AttachVolumeTestJSON-1891370425 None] Created volume successfully. Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-eee77d73-7dfa-4897-8012-ed1773bd1e43 req-450dc8af-7ac1-42fb-a5c5-bd4f6704cdb8 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-eee77d73-7dfa-4897-8012-ed1773bd1e43 req-450dc8af-7ac1-42fb-a5c5-bd4f6704cdb8 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-eee77d73-7dfa-4897-8012-ed1773bd1e43 req-450dc8af-7ac1-42fb-a5c5-bd4f6704cdb8 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-eee77d73-7dfa-4897-8012-ed1773bd1e43 req-450dc8af-7ac1-42fb-a5c5-bd4f6704cdb8 tempest-AttachVolumeTestJSON-1891370425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e37204a9-b471-4fe6-b9c6-286f7c4102ba', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:45:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-eee77d73-7dfa-4897-8012-ed1773bd1e43 req-450dc8af-7ac1-42fb-a5c5-bd4f6704cdb8 tempest-AttachVolumeTestJSON-1891370425 None] attachment_update completed successfully. Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Flow 'volume_create_manager' (b37a644a-eaec-4e55-9ffc-3587e5fb683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccea9154-767a-4615-9f98-639be58e7f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccea9154-767a-4615-9f98-639be58e7f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1655746937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76fd589cf1a44fbb040af57c9e28113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:58Z,use_quota=True,user_id='f7f31ae473fc4dff92202fa0a4c32b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361ffaa8-27f9-4052-bffe-be77c08de4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361ffaa8-27f9-4052-bffe-be77c08de4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ec6ade-3529-4038-9638-5186b6b86358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ec6ade-3529-4038-9638-5186b6b86358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba', 'volume_name': 'volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a4be18-cf82-429c-9d0e-56a0b5426292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a4be18-cf82-429c-9d0e-56a0b5426292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfcae13-ccaa-4e80-974c-d615e9068dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:57 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Volume 3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba', 'volume_size': 1} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1655746937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76fd589cf1a44fbb040af57c9e28113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:45:58Z,use_quota=True,user_id='f7f31ae473fc4dff92202fa0a4c32b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Creating volume 3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:45:57 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:45:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:58 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba 1073741824 Sep 25 13:45:58 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:58 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba 1073741824" returned: 0 in 0.736s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:45:58 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba Sep 25 13:45:58 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:45:59 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba" returned: 0 in 0.358s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfcae13-ccaa-4e80-974c-d615e9068dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe19ae88-c480-4f81-b37e-0162c9104d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:45:59 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Volume volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba (3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba): created successfully Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe19ae88-c480-4f81-b37e-0162c9104d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:45:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Flow 'volume_create_manager' (b37a644a-eaec-4e55-9ffc-3587e5fb683a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:45:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fa87ab55-58fe-4b64-87ef-2855ae9df712 tempest-VolumesTransfersV355Test-392060586 None] Created volume successfully. Sep 25 13:46:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0a754526-8f22-4714-8719-02959bacaa99 tempest-VolumesTransfersV355Test-1653854569 None] Transfer volume completed successfully. Sep 25 13:46:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Acquiring lock "cinder-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Acquiring lock "cinder-quobyte-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-quobyte-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236412d-4a00-41ce-acf4-9c6d67568099]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:02 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba Sep 25 13:46:02 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:03 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba" returned: 0 in 0.596s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:03 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba Sep 25 13:46:03 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:03 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba" returned: 0 in 0.360s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-quobyte-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba" released by "delete_volume" :: held 1.039s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Created reservations ['c432375b-5386-4fb0-a046-eddfb2bf68a3', '6a4a8c6e-b4fd-4a0a-a79c-c509d3d72fd7', '6cb8b37e-7cc7-4c86-8a83-b9c4f17b9237', '6ec681c8-e400-4af6-9d28-20c9e2a720f3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:03 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:03 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:04 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.445s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:04 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Deleted volume successfully. Sep 25 13:46:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-27c09280-5c91-46ca-8c09-c35b93b7259c tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-3f5b544f-4bb3-47c6-b6b2-eb7f5068ddba-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Flow 'volume_create_manager' (c54a530f-2b64-4b1b-baf7-503b7974d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931dfc5-6427-48b2-86b0-22b87206dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931dfc5-6427-48b2-86b0-22b87206dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-841799257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a10476-b1ec-44e9-aacf-d05526c5901a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76fd589cf1a44fbb040af57c9e28113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:05Z,use_quota=True,user_id='f7f31ae473fc4dff92202fa0a4c32b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23591a16-0622-4d6c-a8bb-66ff1953a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23591a16-0622-4d6c-a8bb-66ff1953a500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e098eba1-40a5-47c9-a90b-318e117fbaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e098eba1-40a5-47c9-a90b-318e117fbaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7a10476-b1ec-44e9-aacf-d05526c5901a', 'volume_name': 'volume-a7a10476-b1ec-44e9-aacf-d05526c5901a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fb21d2-5f8c-4601-9e6b-224f2cda4b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fb21d2-5f8c-4601-9e6b-224f2cda4b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca721bb6-db15-4edd-a944-e87cdd5aae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Volume a7a10476-b1ec-44e9-aacf-d05526c5901a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7a10476-b1ec-44e9-aacf-d05526c5901a', 'volume_size': 1} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-841799257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a10476-b1ec-44e9-aacf-d05526c5901a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76fd589cf1a44fbb040af57c9e28113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:05Z,use_quota=True,user_id='f7f31ae473fc4dff92202fa0a4c32b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Creating volume a7a10476-b1ec-44e9-aacf-d05526c5901a {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:05 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:05 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a 1073741824 Sep 25 13:46:05 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:06 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a 1073741824" returned: 0 in 0.684s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:06 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a Sep 25 13:46:06 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:06 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a" returned: 0 in 0.471s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca721bb6-db15-4edd-a944-e87cdd5aae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a10476-b1ec-44e9-aacf-d05526c5901a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cc6a85-5ab8-4915-ad81-02f33b0a0524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:06 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Volume volume-a7a10476-b1ec-44e9-aacf-d05526c5901a (a7a10476-b1ec-44e9-aacf-d05526c5901a): created successfully Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cc6a85-5ab8-4915-ad81-02f33b0a0524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Flow 'volume_create_manager' (c54a530f-2b64-4b1b-baf7-503b7974d85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-24ae5e09-5f2d-4bba-9a83-46e172319e93 tempest-VolumesTransfersV355Test-392060586 None] Created volume successfully. Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Acquiring lock "cinder-a7a10476-b1ec-44e9-aacf-d05526c5901a-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-a7a10476-b1ec-44e9-aacf-d05526c5901a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Acquiring lock "cinder-quobyte-a7a10476-b1ec-44e9-aacf-d05526c5901a" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-quobyte-a7a10476-b1ec-44e9-aacf-d05526c5901a" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d4c3e6-cb78-4a00-8f6f-4e7184b30c5a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:08 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a Sep 25 13:46:08 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (5b2bd7a6-2829-4e0a-b401-8a9714bde3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b7c4ff-6816-4beb-8308-0d2fc05f214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b7c4ff-6816-4beb-8308-0d2fc05f214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-876467610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbe2483-dc18-49e5-b2ae-aca7bb067cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:09Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dd8ad1-e07f-44e8-9a41-c148313420ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dd8ad1-e07f-44e8-9a41-c148313420ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4e2740-72fe-4fc7-b7e1-5824f610bcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4e2740-72fe-4fc7-b7e1-5824f610bcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdbe2483-dc18-49e5-b2ae-aca7bb067cfc', 'volume_name': 'volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61acf8b1-248e-4506-bb30-07f630544a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61acf8b1-248e-4506-bb30-07f630544a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85add1fd-0674-4a93-8377-455d34d96d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume cdbe2483-dc18-49e5-b2ae-aca7bb067cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc', 'volume_size': 1} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-876467610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbe2483-dc18-49e5-b2ae-aca7bb067cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:09Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating volume cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:08 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:09 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc 1073741824 Sep 25 13:46:09 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:09 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a" returned: 0 in 0.855s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:09 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a Sep 25 13:46:09 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:09 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a7a10476-b1ec-44e9-aacf-d05526c5901a" returned: 0 in 0.516s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-quobyte-a7a10476-b1ec-44e9-aacf-d05526c5901a" released by "delete_volume" :: held 1.443s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Created reservations ['d9ca5180-bdef-440e-91db-402eebe7a9c2', '696be547-f199-4171-9922-dd87784b8e6a', 'c66f404e-48f9-4ee2-999f-ffc98a593cdc', 'f2fea8df-6f3c-4317-994c-7a3aeab7fbda'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:09 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc 1073741824" returned: 0 in 0.810s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:09 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc Sep 25 13:46:09 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:09 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:09 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:09 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:09 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:10 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.315s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Deleted volume successfully. Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7464afba-5698-4c58-a07c-b08fba7b584f tempest-VolumesTransfersV355Test-1367966226 None] Lock "cinder-a7a10476-b1ec-44e9-aacf-d05526c5901a-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:10 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85add1fd-0674-4a93-8377-455d34d96d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e7a86d-75a5-4c60-a511-5c0e58a715c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:10 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:46:10 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc (cdbe2483-dc18-49e5-b2ae-aca7bb067cfc): created successfully Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e7a86d-75a5-4c60-a511-5c0e58a715c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (5b2bd7a6-2829-4e0a-b401-8a9714bde3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-cf035991-f8e6-42a4-afd5-a436a0ac6425 tempest-VolumesSnapshotTestJSON-1133345796 None] Created volume successfully. Sep 25 13:46:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating offline snapshot eabc80f5-1c65-497b-a43c-22c930012b4a of volume cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:46:11 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9cd1f2-8fd0-40da-bf30-ca8439115364]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:11 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc Sep 25 13:46:11 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:12 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" returned: 0 in 0.745s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:12 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a 1G Sep 25 13:46:12 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:13 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a 1G" returned: 0 in 0.646s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:13 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a Sep 25 13:46:13 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:13 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a" returned: 0 in 0.537s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:13 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a is being set with open permissions: ugo+rw Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:13 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a Sep 25 13:46:13 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:13 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a" returned: 0 in 0.333s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=142,cinder:SELECT=96,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:46:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:14 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info Sep 25 13:46:14 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:14 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:14 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info is being set with open permissions: ugo+rw Sep 25 13:46:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:14 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info Sep 25 13:46:14 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:14 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.info" returned: 0 in 0.387s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:14 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:DELETE=14,cinder:SELECT=98,cinder:INSERT=33,cinder:UPDATE=121 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:46:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f37c101d-eced-42c0-b05d-74c75628d278 tempest-VolumesSnapshotTestJSON-1133345796 None] Create snapshot completed successfully Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-eabc80f5-1c65-497b-a43c-22c930012b4a-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-eabc80f5-1c65-497b-a43c-22c930012b4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-eabc80f5-1c65-497b-a43c-22c930012b4a" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-eabc80f5-1c65-497b-a43c-22c930012b4a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Deleting offline snapshot eabc80f5-1c65-497b-a43c-22c930012b4a of volume cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] snapshot_file for this snap is: volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8bf3c-9736-4694-acee-7213c064c895]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:16 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a Sep 25 13:46:16 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:16 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a" returned: 0 in 0.594s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e7ceb-1b66-45da-875d-4c9785792a5c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:16 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc Sep 25 13:46:16 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:17 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" returned: 0 in 0.511s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:17 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a Sep 25 13:46:17 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:17 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a" returned: 0 in 0.458s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:17 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a Sep 25 13:46:17 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:18 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc.eabc80f5-1c65-497b-a43c-22c930012b4a" returned: 0 in 0.309s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-eabc80f5-1c65-497b-a43c-22c930012b4a" released by "_delete_snapshot" :: held 2.064s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" released by "delete_snapshot" :: held 2.096s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:18 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['d59c4795-d61c-467b-8677-210fbcabaf9b', 'b59a983e-efc1-4225-a728-3394daea529b', '2311939a-794b-49b4-9acd-5739b67d3c1a', '7feef914-6d3b-41d5-850b-66eb9c752306'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Delete snapshot completed successfully. Sep 25 13:46:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9be34a1a-3152-4b24-b36b-da3944b71fce tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-eabc80f5-1c65-497b-a43c-22c930012b4a-delete_snapshot" released by "delete_snapshot" :: held 2.337s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (6f7dd6e5-bf75-408e-b1de-af4a395656c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918e563f-c4f5-4c65-a961-f65e4697358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918e563f-c4f5-4c65-a961-f65e4697358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-893910454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b386d70-7fdc-462f-af9a-0007ef9b0bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:20Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588ac636-4fff-464d-8140-dd6be622ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588ac636-4fff-464d-8140-dd6be622ed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee102a04-8bd4-46a7-be97-9cafabba3e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee102a04-8bd4-46a7-be97-9cafabba3e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b386d70-7fdc-462f-af9a-0007ef9b0bc4', 'volume_name': 'volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9170aa16-3bca-4ab8-8200-e5ec24fa4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9170aa16-3bca-4ab8-8200-e5ec24fa4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb56f3d4-209e-45df-8bb7-7cf8ac10001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:20 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume 7b386d70-7fdc-462f-af9a-0007ef9b0bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4', 'volume_size': 1} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-893910454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b386d70-7fdc-462f-af9a-0007ef9b0bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:20Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating volume 7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:20 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:20 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 1073741824 Sep 25 13:46:20 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:20 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 1073741824" returned: 0 in 0.592s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:20 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 Sep 25 13:46:20 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:21 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" returned: 0 in 0.382s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb56f3d4-209e-45df-8bb7-7cf8ac10001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ac8eca-a159-43e3-8b72-b758728ed860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:21 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 (7b386d70-7fdc-462f-af9a-0007ef9b0bc4): created successfully Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ac8eca-a159-43e3-8b72-b758728ed860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (6f7dd6e5-bf75-408e-b1de-af4a395656c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-132d1dd0-bb39-45a4-b954-7dfa1e1d48c0 tempest-VolumesSnapshotTestJSON-1133345796 None] Created volume successfully. Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Flow 'volume_create_manager' (ff7d3098-98f7-4751-9030-4e47e17ea684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e946648f-320c-4fb5-bd9a-76358eba1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e946648f-320c-4fb5-bd9a-76358eba1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-56777485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977965f0-1726-4f15-8b53-c1cf76efcfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fe4cb832f34ebb87eb3205474da318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:22Z,use_quota=True,user_id='8954660d7be0428883ef8474dd8cff4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b360a5-bd8e-4b82-b72f-282c5f09fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b360a5-bd8e-4b82-b72f-282c5f09fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3989bccb-f6c7-4326-85a9-0e2bfae06d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3989bccb-f6c7-4326-85a9-0e2bfae06d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977965f0-1726-4f15-8b53-c1cf76efcfb2', 'volume_name': 'volume-977965f0-1726-4f15-8b53-c1cf76efcfb2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecc697d-4506-4b33-a2c9-204cadb41b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecc697d-4506-4b33-a2c9-204cadb41b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de41047-cf2c-40ef-9ce0-674966f778de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:21 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Volume 977965f0-1726-4f15-8b53-c1cf76efcfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977965f0-1726-4f15-8b53-c1cf76efcfb2', 'volume_size': 1} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-56777485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977965f0-1726-4f15-8b53-c1cf76efcfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fe4cb832f34ebb87eb3205474da318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:22Z,use_quota=True,user_id='8954660d7be0428883ef8474dd8cff4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Creating volume 977965f0-1726-4f15-8b53-c1cf76efcfb2 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:21 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:21 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 1073741824 Sep 25 13:46:21 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:22 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 1073741824" returned: 0 in 0.619s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:22 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 Sep 25 13:46:22 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:22 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.309s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de41047-cf2c-40ef-9ce0-674966f778de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977965f0-1726-4f15-8b53-c1cf76efcfb2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1d8bfa-e887-429d-a9f2-7f307880c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating offline snapshot f384463f-002f-4d1c-ae3e-cf51ebcfcf40 of volume 7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:46:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Volume volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 (977965f0-1726-4f15-8b53-c1cf76efcfb2): created successfully Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1d8bfa-e887-429d-a9f2-7f307880c105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Flow 'volume_create_manager' (ff7d3098-98f7-4751-9030-4e47e17ea684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd383e-bf2e-4cee-a5de-40e181a8b9fa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5f229c56-0952-4e71-a78b-eec6503a09dc tempest-VolumesTransfersV357Test-1412401248 None] Created volume successfully. Sep 25 13:46:23 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 Sep 25 13:46:23 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:23 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" returned: 0 in 0.453s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:23 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 1G Sep 25 13:46:23 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:23 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 1G" returned: 0 in 0.492s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:23 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 Sep 25 13:46:23 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:24 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40" returned: 0 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:24 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 is being set with open permissions: ugo+rw Sep 25 13:46:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:24 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 Sep 25 13:46:24 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:24 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40" returned: 0 in 0.357s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:24 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info Sep 25 13:46:24 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a325b6cd-7569-4ffe-902f-667908bb2755 tempest-VolumesTransfersV357Test-42944307 None] Transfer volume completed successfully. Sep 25 13:46:25 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info" returned: 0 in 0.370s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:25 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info is being set with open permissions: ugo+rw Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:25 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info Sep 25 13:46:25 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:25 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.info" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-583f3261-230d-4fcf-88bc-c741517dcf64 tempest-VolumesSnapshotTestJSON-1133345796 None] Create snapshot completed successfully Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Acquiring lock "cinder-977965f0-1726-4f15-8b53-c1cf76efcfb2-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-977965f0-1726-4f15-8b53-c1cf76efcfb2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Acquiring lock "cinder-quobyte-977965f0-1726-4f15-8b53-c1cf76efcfb2" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-quobyte-977965f0-1726-4f15-8b53-c1cf76efcfb2" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde8c2e-7ead-40fa-8ade-13bc89f36c86]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:25 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 Sep 25 13:46:25 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:26 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2" returned: 0 in 0.590s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:26 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2 Sep 25 13:46:26 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (1a576de4-20c9-4162-b2b3-0070c7a43d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f48f171-2948-40c6-8eb1-0d54e5289d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f48f171-2948-40c6-8eb1-0d54e5289d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-462903792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e797200-0e21-4494-8529-e2804cd022cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f384463f-002f-4d1c-ae3e-cf51ebcfcf40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:26Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6ee3c5-e3f9-4c05-8f9d-f3a4b6aaf52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6ee3c5-e3f9-4c05-8f9d-f3a4b6aaf52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f889a1-0068-44e2-9871-11ab5d470311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f889a1-0068-44e2-9871-11ab5d470311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e797200-0e21-4494-8529-e2804cd022cb', 'volume_name': 'volume-0e797200-0e21-4494-8529-e2804cd022cb', 'volume_size': 2, 'snapshot_id': 'f384463f-002f-4d1c-ae3e-cf51ebcfcf40'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56adfd04-7274-497b-93ef-99bda8e65908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56adfd04-7274-497b-93ef-99bda8e65908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6a8249-9e7c-4513-b68e-bfb38b13c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:26 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume 0e797200-0e21-4494-8529-e2804cd022cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e797200-0e21-4494-8529-e2804cd022cb', 'volume_size': 2, 'snapshot_id': 'f384463f-002f-4d1c-ae3e-cf51ebcfcf40'} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-f384463f-002f-4d1c-ae3e-cf51ebcfcf40-0e797200-0e21-4494-8529-e2804cd022cb" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-f384463f-002f-4d1c-ae3e-cf51ebcfcf40-0e797200-0e21-4494-8529-e2804cd022cb" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating volume 0e797200-0e21-4494-8529-e2804cd022cb from snapshot f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:26 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-0e797200-0e21-4494-8529-e2804cd022cb" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-977965f0-1726-4f15-8b53-c1cf76efcfb2" returned: 0 in 0.306s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-0e797200-0e21-4494-8529-e2804cd022cb" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] snapshot: f384463f-002f-4d1c-ae3e-cf51ebcfcf40, volume: 0e797200-0e21-4494-8529-e2804cd022cb, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-quobyte-977965f0-1726-4f15-8b53-c1cf76efcfb2" released by "delete_volume" :: held 0.966s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f250561-11d5-45fa-bc1e-dddca7df8b21]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Created reservations ['a3d10d0a-c8d7-4a45-988d-62ded120cba3', '9d939c95-a3fb-4aca-b91a-5d595fb76703', '567e012d-2287-489e-9f19-533e7bcaa9c3', '9e5485e4-f2a1-4798-9715-bc7da8bb860c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:26 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 Sep 25 13:46:26 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:26 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:26 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:27 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40" returned: 0 in 0.421s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:46:27 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Deleted volume successfully. Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e220f2-4200-48c7-9529-ec19a24cc106]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-09d0f80e-a0f4-447f-8275-f2e4c8a4399c tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-977965f0-1726-4f15-8b53-c1cf76efcfb2-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:27 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 Sep 25 13:46:27 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:27 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" returned: 0 in 0.441s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:46:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:27 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb Sep 25 13:46:27 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:28 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Flow 'volume_create_manager' (10bf9549-efbe-4ba5-9f14-1a7764140148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b4eb8c-e732-42c4-bb05-555370ee5625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b4eb8c-e732-42c4-bb05-555370ee5625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1187340365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfcd30c-7155-4919-8fa9-f109f2c25820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fe4cb832f34ebb87eb3205474da318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:29Z,use_quota=True,user_id='8954660d7be0428883ef8474dd8cff4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2c25ea-5705-45f2-b625-250198c74dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2c25ea-5705-45f2-b625-250198c74dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519f33e0-5bf8-43d3-8aa1-ea4feba86d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519f33e0-5bf8-43d3-8aa1-ea4feba86d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfcd30c-7155-4919-8fa9-f109f2c25820', 'volume_name': 'volume-8cfcd30c-7155-4919-8fa9-f109f2c25820', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e4ce7d-8e85-4dcb-8e19-fca207098e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e4ce7d-8e85-4dcb-8e19-fca207098e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aaf719a-08a8-4919-adee-b22d9ff4df43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Volume 8cfcd30c-7155-4919-8fa9-f109f2c25820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfcd30c-7155-4919-8fa9-f109f2c25820', 'volume_size': 1} Sep 25 13:46:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:34 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb" returned: 0 in 7.275s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:34 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:46:34 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Converted 1024.00 MB image at 140.74 MB/s Sep 25 13:46:34 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb is being set with open permissions: ugo+rw Sep 25 13:46:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:34 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb Sep 25 13:46:34 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:35 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-0e797200-0e21-4494-8529-e2804cd022cb" released by "_copy_volume_from_snapshot" :: held 8.550s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-f384463f-002f-4d1c-ae3e-cf51ebcfcf40-0e797200-0e21-4494-8529-e2804cd022cb" released by "_create_volume_from_snapshot" :: held 8.644s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.663s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.221s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1187340365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfcd30c-7155-4919-8fa9-f109f2c25820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fe4cb832f34ebb87eb3205474da318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:29Z,use_quota=True,user_id='8954660d7be0428883ef8474dd8cff4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Creating volume 8cfcd30c-7155-4919-8fa9-f109f2c25820 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:35 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:35 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 1073741824 Sep 25 13:46:35 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6a8249-9e7c-4513-b68e-bfb38b13c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e797200-0e21-4494-8529-e2804cd022cb', 'volume_size': 2, 'snapshot_id': 'f384463f-002f-4d1c-ae3e-cf51ebcfcf40'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f52644b-5a1f-47f4-a1f4-2a2c1328de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:35 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume volume-0e797200-0e21-4494-8529-e2804cd022cb (0e797200-0e21-4494-8529-e2804cd022cb): created successfully Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f52644b-5a1f-47f4-a1f4-2a2c1328de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (1a576de4-20c9-4162-b2b3-0070c7a43d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3d9167f8-d682-4192-9cc2-f230d5de0e42 tempest-VolumesSnapshotTestJSON-1133345796 None] Created volume successfully. Sep 25 13:46:35 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 1073741824" returned: 0 in 0.590s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:35 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 Sep 25 13:46:35 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-6ba1095d-f736-45ff-829e-c879af7e08c4 req-654a4cc5-5441-4c87-aa6b-9f4b556ab1a9 tempest-AttachVolumeTestJSON-1891370425 None] Terminate volume connection completed successfully. Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-6ba1095d-f736-45ff-829e-c879af7e08c4 req-654a4cc5-5441-4c87-aa6b-9f4b556ab1a9 tempest-AttachVolumeTestJSON-1891370425 None] Deleting attachment e37204a9-b471-4fe6-b9c6-286f7c4102ba. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:46:36 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820" returned: 0 in 0.332s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aaf719a-08a8-4919-adee-b22d9ff4df43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfcd30c-7155-4919-8fa9-f109f2c25820', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e992a7-b432-4082-b825-f67268e8a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:36 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Volume volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 (8cfcd30c-7155-4919-8fa9-f109f2c25820): created successfully Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e992a7-b432-4082-b825-f67268e8a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Flow 'volume_create_manager' (10bf9549-efbe-4ba5-9f14-1a7764140148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e1f45181-2a76-4d47-9250-f3a135403c82 tempest-VolumesTransfersV357Test-1412401248 None] Created volume successfully. Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-0e797200-0e21-4494-8529-e2804cd022cb-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-0e797200-0e21-4494-8529-e2804cd022cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-0e797200-0e21-4494-8529-e2804cd022cb" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-0e797200-0e21-4494-8529-e2804cd022cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f7b329-26a0-4cce-b5fb-cfbfbdb0065e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:36 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb Sep 25 13:46:36 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:37 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb" returned: 0 in 0.471s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:37 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb Sep 25 13:46:37 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:37 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e797200-0e21-4494-8529-e2804cd022cb" returned: 0 in 0.315s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-0e797200-0e21-4494-8529-e2804cd022cb" released by "delete_volume" :: held 0.851s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['8c7a3c27-a6b8-4c51-9009-40c1414766cb', 'b0b98448-8e1d-4b2c-89ce-916eb9fbd6b9', 'c185da1f-a109-4239-a74f-d0917babd64c', 'c8a84286-f779-478f-a00e-0f7f8c2bd4b1'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:37 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:37 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-f384463f-002f-4d1c-ae3e-cf51ebcfcf40-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-f384463f-002f-4d1c-ae3e-cf51ebcfcf40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Acquiring lock "cinder-8cfcd30c-7155-4919-8fa9-f109f2c25820-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-f384463f-002f-4d1c-ae3e-cf51ebcfcf40" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-8cfcd30c-7155-4919-8fa9-f109f2c25820-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-f384463f-002f-4d1c-ae3e-cf51ebcfcf40" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Deleting offline snapshot f384463f-002f-4d1c-ae3e-cf51ebcfcf40 of volume 7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] snapshot_file for this snap is: volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[841c66a3-2022-48b9-b8fa-a1c49ded7e62]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Acquiring lock "cinder-quobyte-8cfcd30c-7155-4919-8fa9-f109f2c25820" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:38 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.434s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-quobyte-8cfcd30c-7155-4919-8fa9-f109f2c25820" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:38 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Deleted volume successfully. Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0db8ca-e270-4763-af30-3cd5632bdc4d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2688ca98-1aeb-47b6-90d5-20793bda6a0a tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-0e797200-0e21-4494-8529-e2804cd022cb-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:38 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 Sep 25 13:46:38 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:38 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 Sep 25 13:46:38 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:38 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40" returned: 0 in 0.483s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f174c3-b5e8-494f-95ec-3fd8e32fcfbf]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:38 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820" returned: 0 in 0.475s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:38 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820 Sep 25 13:46:38 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:38 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 Sep 25 13:46:38 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:39 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cfcd30c-7155-4919-8fa9-f109f2c25820" returned: 0 in 0.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-quobyte-8cfcd30c-7155-4919-8fa9-f109f2c25820" released by "delete_volume" :: held 0.920s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Created reservations ['ad23690d-e324-4443-a1aa-e0ef1f8dad4f', 'e56815a7-537f-4c91-8bd0-2ab5bcf82972', 'c4f1a887-c975-4760-813e-ebdbb5c24228', '80797b96-c4b4-4e6c-b58e-13aa71721580'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:39 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:39 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:39 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" returned: 0 in 0.778s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:39 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 Sep 25 13:46:39 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:39 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.356s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Deleted volume successfully. Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b2920b4c-104f-46fb-8d1e-7267c288d9e8 tempest-VolumesTransfersV357Test-83085537 None] Lock "cinder-8cfcd30c-7155-4919-8fa9-f109f2c25820-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:39 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40" returned: 0 in 0.448s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:39 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40 Sep 25 13:46:39 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:40 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4.f384463f-002f-4d1c-ae3e-cf51ebcfcf40" returned: 0 in 0.463s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-f384463f-002f-4d1c-ae3e-cf51ebcfcf40" released by "_delete_snapshot" :: held 2.368s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" released by "delete_snapshot" :: held 2.418s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:40 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['5f16d80d-9d06-42c0-8232-ddf9cb5e2786', 'cc4ab443-f5d7-4da6-a9cb-697049e760d5', '0141da47-3446-4e3f-a8bf-195065a6cc3b', '7eb5c246-b796-40fe-8ce9-f5d9a35ee05a'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Delete snapshot completed successfully. Sep 25 13:46:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4d5571c8-8a8b-4514-ab9d-ed9c870adb1f tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-f384463f-002f-4d1c-ae3e-cf51ebcfcf40-delete_snapshot" released by "delete_snapshot" :: held 2.675s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-7b386d70-7fdc-462f-af9a-0007ef9b0bc4-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-7b386d70-7fdc-462f-af9a-0007ef9b0bc4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:41 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b244fe-1ffb-44c0-a81f-41e872bfc5b4]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:42 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 Sep 25 13:46:42 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:42 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" returned: 0 in 0.949s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:42 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4 Sep 25 13:46:42 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:42 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" returned: 0 in 0.291s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-7b386d70-7fdc-462f-af9a-0007ef9b0bc4" released by "delete_volume" :: held 1.364s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['8d57a80b-1e25-41ac-a3d2-144c24a5de56', 'b04ddf35-0305-4083-8020-7a0dde3419d1', '15ee4b0d-9d3f-4ee9-ae5d-128d06e648d8', '23019edd-9e55-4cad-aafe-789f6cff4c7f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:43 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:46:43 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:43 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.394s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:46:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Deleted volume successfully. Sep 25 13:46:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-15940502-d565-4cdb-aaf6-6b7844f42c5b tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-7b386d70-7fdc-462f-af9a-0007ef9b0bc4-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (f3ad6f7f-4ddc-4490-8ae8-311be7c84050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776822ba-cc1e-46b1-aab9-6d5d07d89fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776822ba-cc1e-46b1-aab9-6d5d07d89fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1997165426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5405472a-fc50-40a9-ae5a-59b9e6f096bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:45Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1fe27f-096b-47e7-acc7-6c2842fa22e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1fe27f-096b-47e7-acc7-6c2842fa22e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87080464-ce91-46ec-994b-0cd342e845a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87080464-ce91-46ec-994b-0cd342e845a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5405472a-fc50-40a9-ae5a-59b9e6f096bf', 'volume_name': 'volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0438a67a-dc4b-4462-91f2-65317cdce253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0438a67a-dc4b-4462-91f2-65317cdce253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d577951f-84bf-4196-a98c-7fac7cbc6999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Volume 5405472a-fc50-40a9-ae5a-59b9e6f096bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf', 'volume_size': 1} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1997165426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5405472a-fc50-40a9-ae5a-59b9e6f096bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:45Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Creating volume 5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:44 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:44 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf 1073741824 Sep 25 13:46:44 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:45 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf 1073741824" returned: 0 in 0.640s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:45 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf Sep 25 13:46:45 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:45 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf" returned: 0 in 0.308s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d577951f-84bf-4196-a98c-7fac7cbc6999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db41008-6f25-4fef-955d-314ad8a357ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Volume volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf (5405472a-fc50-40a9-ae5a-59b9e6f096bf): created successfully Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db41008-6f25-4fef-955d-314ad8a357ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (f3ad6f7f-4ddc-4490-8ae8-311be7c84050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d9dd269a-0d79-4b12-9a20-80a8dc67b07d tempest-VolumesSnapshotTestJSON-1133345796 None] Created volume successfully. Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating offline snapshot a9f8d5b7-d492-4e59-aa07-f98fe7401627 of volume 5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84cb7c-0776-4894-9f06-15e3d5b121d2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:47 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf Sep 25 13:46:47 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:47 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf" returned: 0 in 0.468s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:47 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 1G Sep 25 13:46:47 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:48 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 1G" returned: 0 in 0.494s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:48 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 Sep 25 13:46:48 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:48 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:48 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 is being set with open permissions: ugo+rw Sep 25 13:46:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:48 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 Sep 25 13:46:48 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:48 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627" returned: 0 in 0.298s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:48 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info Sep 25 13:46:48 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:49 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info" returned: 0 in 0.272s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:49 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info is being set with open permissions: ugo+rw Sep 25 13:46:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:49 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info Sep 25 13:46:49 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:49 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.info" returned: 0 in 0.267s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c0e79019-c124-4b3d-9ce5-35edb78a0bd0 tempest-VolumesSnapshotTestJSON-1133345796 None] Create snapshot completed successfully Sep 25 13:46:49 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (6e9c4669-6a5e-460a-81bf-49ecca3677ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c533ba50-5705-4b67-819e-80d7f5fd8156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c533ba50-5705-4b67-819e-80d7f5fd8156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892196747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e5d291-0e24-43d9-8160-3af1814501dd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:50Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578b410a-d651-43ba-84c1-8e212c5ec091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578b410a-d651-43ba-84c1-8e212c5ec091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ec2ee1-4d1b-49f5-86ca-7bab6a760d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ec2ee1-4d1b-49f5-86ca-7bab6a760d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e5d291-0e24-43d9-8160-3af1814501dd', 'volume_name': 'volume-e5e5d291-0e24-43d9-8160-3af1814501dd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f029e904-f2b1-4b29-8b16-37502e343872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f029e904-f2b1-4b29-8b16-37502e343872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc60e2-e603-4ff0-b777-2acee245a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:50 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Volume e5e5d291-0e24-43d9-8160-3af1814501dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e5d291-0e24-43d9-8160-3af1814501dd', 'volume_size': 1} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892196747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e5d291-0e24-43d9-8160-3af1814501dd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:50Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Creating volume e5e5d291-0e24-43d9-8160-3af1814501dd {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:50 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:50 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd 1073741824 Sep 25 13:46:50 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:50 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd 1073741824" returned: 0 in 0.487s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:50 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd Sep 25 13:46:50 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:50 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:51 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (7646d069-3748-4078-9816-e9fce1570368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583743ea-a2f9-4efa-883f-9ab6d774739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd" returned: 0 in 0.407s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583743ea-a2f9-4efa-883f-9ab6d774739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-390851408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a893319af884906a13c0693bad934df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9f8d5b7-d492-4e59-aa07-f98fe7401627,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:51Z,use_quota=True,user_id='c05dfb86e1234f2e99a6c520d5f35fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63207d46-ed1d-4955-8563-d9786e35ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63207d46-ed1d-4955-8563-d9786e35ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4712447-0548-4090-b432-2ce74c44fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4712447-0548-4090-b432-2ce74c44fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751', 'volume_name': 'volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751', 'volume_size': 1, 'snapshot_id': 'a9f8d5b7-d492-4e59-aa07-f98fe7401627'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79918cae-7932-4acc-8196-78cee9735e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79918cae-7932-4acc-8196-78cee9735e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c853eb9-6454-4de7-80d6-e7e0c4167245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume 25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751', 'volume_size': 1, 'snapshot_id': 'a9f8d5b7-d492-4e59-aa07-f98fe7401627'} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc60e2-e603-4ff0-b777-2acee245a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e5d291-0e24-43d9-8160-3af1814501dd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0102239-9ba1-4b15-b70f-be1abb60e03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-a9f8d5b7-d492-4e59-aa07-f98fe7401627-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-a9f8d5b7-d492-4e59-aa07-f98fe7401627-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating volume 25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 from snapshot a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:46:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Volume volume-e5e5d291-0e24-43d9-8160-3af1814501dd (e5e5d291-0e24-43d9-8160-3af1814501dd): created successfully Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0102239-9ba1-4b15-b70f-be1abb60e03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (6e9c4669-6a5e-460a-81bf-49ecca3677ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6391f834-c2f7-402e-99b6-3e51670bc4cc tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] snapshot: a9f8d5b7-d492-4e59-aa07-f98fe7401627, volume: 25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb634511-928f-4b82-a759-25172c701613]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:51 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 Sep 25 13:46:51 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:51 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627" returned: 0 in 0.388s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f686a561-a81c-4eab-be1c-64212d9ec034]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:46:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:51 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf Sep 25 13:46:51 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:52 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:46:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:46:52 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:46:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:52 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 Sep 25 13:46:52 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (4ff225cd-c836-40ee-8df5-9c7075998241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d1be06-4b52-4dc2-a286-e5b25ffa48c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d1be06-4b52-4dc2-a286-e5b25ffa48c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-246473823',display_name='tempest-VolumesGetTest-Volume-359088418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb12997c-8209-4034-bf07-845c5ccb0b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:53Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31a56e4-9792-4fcc-b4bf-2c82aaacbc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31a56e4-9792-4fcc-b4bf-2c82aaacbc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fed1df1-d6fd-4e0a-8055-2fe515fee718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fed1df1-d6fd-4e0a-8055-2fe515fee718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb12997c-8209-4034-bf07-845c5ccb0b59', 'volume_name': 'volume-eb12997c-8209-4034-bf07-845c5ccb0b59', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054fcffd-2d06-4980-b681-e26c875c2469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054fcffd-2d06-4980-b681-e26c875c2469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b21b4f0-2f08-4ad5-b1d1-6596441164d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:46:53 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Volume eb12997c-8209-4034-bf07-845c5ccb0b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb12997c-8209-4034-bf07-845c5ccb0b59', 'volume_size': 1} Sep 25 13:46:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:59 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" returned: 0 in 7.511s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf, size 1024.00 MB, duration 7.51 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:46:59 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Converted 1024.00 MB image at 136.31 MB/s Sep 25 13:46:59 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 is being set with open permissions: ugo+rw Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:46:59 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 Sep 25 13:46:59 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:46:59 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" returned: 0 in 0.323s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" released by "_copy_volume_from_snapshot" :: held 8.711s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-a9f8d5b7-d492-4e59-aa07-f98fe7401627-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" released by "_create_volume_from_snapshot" :: held 8.813s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.835s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.177s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:46:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-246473823',display_name='tempest-VolumesGetTest-Volume-359088418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb12997c-8209-4034-bf07-845c5ccb0b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:46:53Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Creating volume eb12997c-8209-4034-bf07-845c5ccb0b59 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:46:59 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:46:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:00 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 1073741824 Sep 25 13:47:00 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c853eb9-6454-4de7-80d6-e7e0c4167245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751', 'volume_size': 1, 'snapshot_id': 'a9f8d5b7-d492-4e59-aa07-f98fe7401627'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7632049-85ef-45c3-999d-b20cfd51fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Volume volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 (25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751): created successfully Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7632049-85ef-45c3-999d-b20cfd51fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Flow 'volume_create_manager' (7646d069-3748-4078-9816-e9fce1570368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-51c8944a-9697-41f9-a3ba-8edb9a65e6a9 tempest-VolumesSnapshotTestJSON-1133345796 None] Created volume successfully. Sep 25 13:47:00 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 1073741824" returned: 0 in 0.500s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:00 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 Sep 25 13:47:00 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:00 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b21b4f0-2f08-4ad5-b1d1-6596441164d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb12997c-8209-4034-bf07-845c5ccb0b59', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90dbcf6-ff01-4662-b80e-a8c9ffdc8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Volume volume-eb12997c-8209-4034-bf07-845c5ccb0b59 (eb12997c-8209-4034-bf07-845c5ccb0b59): created successfully Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90dbcf6-ff01-4662-b80e-a8c9ffdc8caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (4ff225cd-c836-40ee-8df5-9c7075998241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6fff9f89-1bf1-4f0e-a78f-3e59998275cf tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-eb12997c-8209-4034-bf07-845c5ccb0b59-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Lock "cinder-eb12997c-8209-4034-bf07-845c5ccb0b59-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-eb12997c-8209-4034-bf07-845c5ccb0b59" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-eb12997c-8209-4034-bf07-845c5ccb0b59" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d5cbd-716c-4cec-859d-3e0e3fbedef5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d21795-9978-4ce2-bcb1-11ed370591cc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:01 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 Sep 25 13:47:01 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:01 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 Sep 25 13:47:01 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:01 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:01 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59 Sep 25 13:47:01 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:01 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" returned: 0 in 0.409s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:01 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751 Sep 25 13:47:01 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:02 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-eb12997c-8209-4034-bf07-845c5ccb0b59" returned: 0 in 0.367s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:02 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" returned: 0 in 0.303s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-eb12997c-8209-4034-bf07-845c5ccb0b59" released by "delete_volume" :: held 0.883s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751" released by "delete_volume" :: held 0.774s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Created reservations ['40a758a5-5062-4c7e-bbb3-e1b2fe1a64fe', '88d9999e-392c-4199-99aa-5b46caf94ee3', 'cf3b8d78-ba68-44b1-8f73-4c3e823fe42c', 'bb2bcf80-722b-455b-882e-65ebd25bb478'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['ba803006-72e8-46e3-b027-e4b545f1f8d0', '42d12b47-6131-46b3-8557-73bd71712728', '15ecf350-8b05-444d-9001-517b1585dc34', '5130f9d7-b64a-4ae5-92d1-82a5416f06ec'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:02 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:02 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:02 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:02 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-e5e5d291-0e24-43d9-8160-3af1814501dd-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Lock "cinder-e5e5d291-0e24-43d9-8160-3af1814501dd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-a9f8d5b7-d492-4e59-aa07-f98fe7401627-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-a9f8d5b7-d492-4e59-aa07-f98fe7401627-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-5405472a-fc50-40a9-ae5a-59b9e6f096bf" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-e5e5d291-0e24-43d9-8160-3af1814501dd" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-5405472a-fc50-40a9-ae5a-59b9e6f096bf" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-a9f8d5b7-d492-4e59-aa07-f98fe7401627" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-e5e5d291-0e24-43d9-8160-3af1814501dd" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-a9f8d5b7-d492-4e59-aa07-f98fe7401627" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Deleting offline snapshot a9f8d5b7-d492-4e59-aa07-f98fe7401627 of volume 5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] snapshot_file for this snap is: volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda6f240-54a3-4d57-9708-2d9d8d85eb08]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:02 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9e13a1-cbd9-456b-9a10-16d6dedd71d2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.409s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:02 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.402s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b5b50094-3e8a-43de-ba93-a22d9d3bb742 tempest-VolumesGetTest-272626769 None] Lock "cinder-eb12997c-8209-4034-bf07-845c5ccb0b59-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Deleted volume successfully. Sep 25 13:47:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90efde03-506a-4f92-b41a-db909be5c976 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-25cd75bd-fe4f-42ec-a5f0-3a4b5c5d0751-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:02 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 Sep 25 13:47:02 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:02 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd Sep 25 13:47:02 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:03 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd" returned: 0 in 0.455s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:03 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627" returned: 0 in 0.453s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:47:03 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd Sep 25 13:47:03 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd5c30-c051-4625-a34f-d3e7abdd6b3f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:03 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf Sep 25 13:47:03 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:03 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e5e5d291-0e24-43d9-8160-3af1814501dd" returned: 0 in 0.342s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-e5e5d291-0e24-43d9-8160-3af1814501dd" released by "delete_volume" :: held 0.869s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Created reservations ['aa09b194-fdcf-44a7-9b0b-7dc9dd8efe7a', 'a524af3e-3afb-4659-8eee-72fc42e7d32d', '0f8fa4e5-8d77-4e12-9317-b6048f24e074', '6989e339-e5b2-4516-ad52-f9b3c8b9c2a3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:03 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:03 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:04 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf" returned: 0 in 0.855s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:04 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.394s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:04 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 Sep 25 13:47:04 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3f1cc81d-9e64-488e-8e23-1186c352ca6e tempest-VolumesGetTest-272626769 None] Lock "cinder-e5e5d291-0e24-43d9-8160-3af1814501dd-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (e27c30b5-aa6e-470d-8238-98919d91b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667bef1d-9938-468c-9408-08d82034d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667bef1d-9938-468c-9408-08d82034d0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1182807577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cff11ba-0da3-40e9-8881-8577ba7254e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:05Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca78d615-2f18-4533-8e92-a512a2aa95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca78d615-2f18-4533-8e92-a512a2aa95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb657e6-0cfa-4758-afc7-a7db45a35b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb657e6-0cfa-4758-afc7-a7db45a35b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cff11ba-0da3-40e9-8881-8577ba7254e4', 'volume_name': 'volume-0cff11ba-0da3-40e9-8881-8577ba7254e4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2daa822-4127-4410-b904-292c19bb2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2daa822-4127-4410-b904-292c19bb2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5510f44-cb53-4327-999f-c21ceb988f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:04 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Volume 0cff11ba-0da3-40e9-8881-8577ba7254e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cff11ba-0da3-40e9-8881-8577ba7254e4', 'volume_size': 1} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1182807577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cff11ba-0da3-40e9-8881-8577ba7254e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:05Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Creating volume 0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:04 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:04 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627" returned: 0 in 0.654s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:04 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 1073741824 Sep 25 13:47:04 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:04 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627 Sep 25 13:47:04 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:05 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf.a9f8d5b7-d492-4e59-aa07-f98fe7401627" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-a9f8d5b7-d492-4e59-aa07-f98fe7401627" released by "_delete_snapshot" :: held 2.507s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-5405472a-fc50-40a9-ae5a-59b9e6f096bf" released by "delete_snapshot" :: held 2.550s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['9da35174-3625-4e5e-87a4-50b245e53e23', 'e81010b0-1c2f-457a-8f8d-9d9a3027093a', 'de38f904-35b3-4ce1-b259-dfc3ef01bab8', '2cba144c-8eb3-4f5b-ba20-ab9ab85bbd39'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Delete snapshot completed successfully. Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d62bb1fb-bf22-4f94-aa5b-705ae5be5ed1 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-a9f8d5b7-d492-4e59-aa07-f98fe7401627-delete_snapshot" released by "delete_snapshot" :: held 2.786s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:05 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 1073741824" returned: 0 in 0.719s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:05 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 Sep 25 13:47:05 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:05 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5510f44-cb53-4327-999f-c21ceb988f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cff11ba-0da3-40e9-8881-8577ba7254e4', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f593e272-45f5-45cc-b036-37581d220ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Volume volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 (0cff11ba-0da3-40e9-8881-8577ba7254e4): created successfully Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f593e272-45f5-45cc-b036-37581d220ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (e27c30b5-aa6e-470d-8238-98919d91b3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ac7b0d1c-6b7e-420c-82a0-8df67a45d3bc tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-5405472a-fc50-40a9-ae5a-59b9e6f096bf-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-5405472a-fc50-40a9-ae5a-59b9e6f096bf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-5405472a-fc50-40a9-ae5a-59b9e6f096bf" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-5405472a-fc50-40a9-ae5a-59b9e6f096bf" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a141d198-6973-484b-b586-43cf448f5299]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:06 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf Sep 25 13:47:06 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:06 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf" returned: 0 in 0.407s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:06 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf Sep 25 13:47:06 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:06 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5405472a-fc50-40a9-ae5a-59b9e6f096bf" returned: 0 in 0.294s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-5405472a-fc50-40a9-ae5a-59b9e6f096bf" released by "delete_volume" :: held 0.783s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:06 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['89d1ab46-aed7-4b06-82c6-f4532c790814', '34994b44-bf0b-482a-b00e-9914ed86bba5', 'def2c311-4a79-4487-8709-e0364ea3c561', 'ce2d941e-42b3-43ee-be69-19a9265bde89'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:07 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:07 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:07 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.368s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Deleted volume successfully. Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a9a47d97-2c34-47fa-8a1c-ff7059177b84 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-5405472a-fc50-40a9-ae5a-59b9e6f096bf-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "cinder-quobyte-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (bfaca417-0fd2-4c2f-b0d2-598be6d693f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c73bbab-ff9b-4b62-bf2b-c0925141d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" acquired by "delete_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c73bbab-ff9b-4b62-bf2b-c0925141d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1719581096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780b3240-b88c-4152-8bf2-e3a56b264893,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0cff11ba-0da3-40e9-8881-8577ba7254e4,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:07Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c4fa4f-72c4-4c09-9d79-e50f61fe4db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c4fa4f-72c4-4c09-9d79-e50f61fe4db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5270518-2315-4bd2-9cd1-01bc27d15333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[63caaf92-1a05-490e-a13b-96c8c41fffb2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5270518-2315-4bd2-9cd1-01bc27d15333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '780b3240-b88c-4152-8bf2-e3a56b264893', 'volume_name': 'volume-780b3240-b88c-4152-8bf2-e3a56b264893', 'volume_size': 1, 'source_volid': '0cff11ba-0da3-40e9-8881-8577ba7254e4', 'source_volstatus': 'available'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a5d7c2-9c1a-4489-a314-561cc508b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a5d7c2-9c1a-4489-a314-561cc508b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0018294-6194-4036-a5ea-8da19380b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Volume 780b3240-b88c-4152-8bf2-e3a56b264893: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-780b3240-b88c-4152-8bf2-e3a56b264893', 'volume_size': 1, 'source_volid': '0cff11ba-0da3-40e9-8881-8577ba7254e4', 'source_volstatus': 'available'} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:07 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Cloning volume 0cff11ba-0da3-40e9-8881-8577ba7254e4 to volume 780b3240-b88c-4152-8bf2-e3a56b264893 Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Creating offline snapshot 803c1e68-e263-49f2-ab4a-7ac540b01206 of volume 0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd6fbe0-cf7d-4aae-a2f5-ff5462c36fdf]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:07 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc Sep 25 13:47:07 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:07 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 Sep 25 13:47:08 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:08 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" returned: 0 in 0.532s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:08 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc Sep 25 13:47:08 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:08 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4" returned: 0 in 0.528s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:08 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 1G Sep 25 13:47:08 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:08 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" returned: 0 in 0.551s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-quobyte-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc" released by "delete_volume" :: held 1.198s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:08 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Created reservations ['070c4eba-4433-4823-a53f-28b09c7b75be', 'db1c528d-7514-424a-90c3-9a3c7afa6dfd', 'ac973390-5139-4162-b51b-64cc9bb36200', 'b1208d8f-f151-48b1-94ad-6bfbf515cfa7'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:09 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:09 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:09 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 1G" returned: 0 in 0.806s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:09 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 Sep 25 13:47:09 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:09 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.366s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Deleted volume successfully. Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-563aa520-92f4-4707-a7c8-6ed4589118d5 tempest-VolumesSnapshotTestJSON-1133345796 None] Lock "cinder-cdbe2483-dc18-49e5-b2ae-aca7bb067cfc-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206" returned: 0 in 0.450s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:09 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 is being set with open permissions: ugo+rw Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:09 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:09 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 Sep 25 13:47:09 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:09 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:09 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:09 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206" returned: 0 in 0.358s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:10 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info Sep 25 13:47:10 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:10 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.439s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:47:10 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info" returned: 0 in 0.395s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:10 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info is being set with open permissions: ugo+rw Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:10 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info Sep 25 13:47:10 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:10 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.info" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-780b3240-b88c-4152-8bf2-e3a56b264893" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-780b3240-b88c-4152-8bf2-e3a56b264893" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] snapshot: 803c1e68-e263-49f2-ab4a-7ac540b01206, volume: 780b3240-b88c-4152-8bf2-e3a56b264893, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627c6c8-8f6b-48a4-896c-e5217197ee3c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:11 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 Sep 25 13:47:11 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:11 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206" returned: 0 in 0.483s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cff11ba-0da3-40e9-8881-8577ba7254e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac0c7d-b5e7-437e-8b4e-a64410e49127]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:11 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 Sep 25 13:47:11 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:11 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4" returned: 0 in 0.515s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:47:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:11 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 Sep 25 13:47:11 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=115,cinder:DELETE=12,cinder:INSERT=25,cinder:UPDATE=109 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=133,cinder:SELECT=88,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:47:20 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893" returned: 0 in 8.291s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:47:20 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Converted 1024.00 MB image at 123.50 MB/s Sep 25 13:47:20 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 is being set with open permissions: ugo+rw Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:20 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 Sep 25 13:47:20 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:20 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-780b3240-b88c-4152-8bf2-e3a56b264893" released by "_copy_volume_from_snapshot" :: held 9.760s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-803c1e68-e263-49f2-ab4a-7ac540b01206" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-803c1e68-e263-49f2-ab4a-7ac540b01206" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Deleting offline snapshot 803c1e68-e263-49f2-ab4a-7ac540b01206 of volume 0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] snapshot_file for this snap is: volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdc9bc5-73ed-4924-aaa7-85d3a4723896]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:20 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 Sep 25 13:47:20 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:21 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206" returned: 0 in 0.498s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cff11ba-0da3-40e9-8881-8577ba7254e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:47:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bda5a1-d1e6-4341-902a-f68f51d957e8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:21 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 Sep 25 13:47:21 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:22 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4" returned: 0 in 0.809s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:22 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 Sep 25 13:47:22 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:22 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206" returned: 0 in 0.515s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:22 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206 Sep 25 13:47:22 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:22 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4.803c1e68-e263-49f2-ab4a-7ac540b01206" returned: 0 in 0.378s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-803c1e68-e263-49f2-ab4a-7ac540b01206" released by "_delete_snapshot" :: held 2.360s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.266s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0018294-6194-4036-a5ea-8da19380b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780b3240-b88c-4152-8bf2-e3a56b264893', 'volume_size': 1, 'source_volid': '0cff11ba-0da3-40e9-8881-8577ba7254e4', 'source_volstatus': 'available'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87398670-74b1-4a2c-bf29-448097791ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:23 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Volume volume-780b3240-b88c-4152-8bf2-e3a56b264893 (780b3240-b88c-4152-8bf2-e3a56b264893): created successfully Sep 25 13:47:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87398670-74b1-4a2c-bf29-448097791ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (bfaca417-0fd2-4c2f-b0d2-598be6d693f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fd0e5be3-77c4-472a-a77c-4278d6214ea6 tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Flow 'volume_create_manager' (604057a3-7548-462a-aab6-9dc46e5922f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc39dcf-1700-49a2-a196-d05fa35fd9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc39dcf-1700-49a2-a196-d05fa35fd9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-150309036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627f94be-58e1-479d-967a-1a6fff46c5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93097f6a9c6547a08c6e22f511084214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:24Z,use_quota=True,user_id='359cc74948a942029eb10a6254d3809d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdb88bf-6e2b-4675-b79d-97ccfcc5a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdb88bf-6e2b-4675-b79d-97ccfcc5a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4469d80a-31eb-4ec9-9695-d6b190243568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4469d80a-31eb-4ec9-9695-d6b190243568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627f94be-58e1-479d-967a-1a6fff46c5b8', 'volume_name': 'volume-627f94be-58e1-479d-967a-1a6fff46c5b8', 'volume_size': 2}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182f798a-3877-48a8-be63-55ea765cf80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182f798a-3877-48a8-be63-55ea765cf80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a504e280-aefb-4c72-a964-e1287ae5a9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:24 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Volume 627f94be-58e1-479d-967a-1a6fff46c5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627f94be-58e1-479d-967a-1a6fff46c5b8', 'volume_size': 2} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-150309036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627f94be-58e1-479d-967a-1a6fff46c5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93097f6a9c6547a08c6e22f511084214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:24Z,use_quota=True,user_id='359cc74948a942029eb10a6254d3809d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Creating volume 627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:24 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 2147483648 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:24 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 2147483648 Sep 25 13:47:24 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:25 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 2147483648" returned: 0 in 0.738s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:25 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 Sep 25 13:47:25 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (2c06cd6d-4287-417a-8599-0c77ee26c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c88ab96-817f-4a2a-ba6b-bab9028a876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c88ab96-817f-4a2a-ba6b-bab9028a876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1524330257',display_name='tempest-VolumesGetTest-Volume-1209723318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:25Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a168c09c-3f50-4ba8-892a-5512a418367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a168c09c-3f50-4ba8-892a-5512a418367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b354461-9107-41b9-a880-62745490508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b354461-9107-41b9-a880-62745490508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb', 'volume_name': 'volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57820ef7-7c7f-4263-b64a-09add7d03529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57820ef7-7c7f-4263-b64a-09add7d03529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52905ae9-3afc-44f7-b42e-0bf52eec0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:25 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Volume 7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb', 'volume_size': 1} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:25 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1524330257',display_name='tempest-VolumesGetTest-Volume-1209723318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:25Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Creating volume 7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:25 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a504e280-aefb-4c72-a964-e1287ae5a9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627f94be-58e1-479d-967a-1a6fff46c5b8', 'volume_size': 2}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:25 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb 1073741824 Sep 25 13:47:25 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ca0d65-1837-448c-8f5e-1c56a510bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:25 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Volume volume-627f94be-58e1-479d-967a-1a6fff46c5b8 (627f94be-58e1-479d-967a-1a6fff46c5b8): created successfully Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ca0d65-1837-448c-8f5e-1c56a510bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Flow 'volume_create_manager' (604057a3-7548-462a-aab6-9dc46e5922f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3143224e-4251-48dc-a934-d79a5aa04536 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Created volume successfully. Sep 25 13:47:26 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb 1073741824" returned: 0 in 0.805s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:26 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb Sep 25 13:47:26 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:27 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb" returned: 0 in 0.648s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.136s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52905ae9-3afc-44f7-b42e-0bf52eec0042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbddc73c-4a4a-4fa7-86c8-5fc5620ac82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Creating offline snapshot 2b7a1728-4ebe-4916-8245-5997b68f081c of volume 627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:47:27 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Volume volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb (7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb): created successfully Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbddc73c-4a4a-4fa7-86c8-5fc5620ac82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (2c06cd6d-4287-417a-8599-0c77ee26c17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[44636c3e-dbc3-49d9-936e-e0240987c7d7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3196eeaf-a284-4546-a2e2-d9204ebc5891 tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:47:27 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 Sep 25 13:47:27 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Lock "cinder-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa5348a-2833-4733-9e7b-9cf5b9de1267]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:27 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8" returned: 0 in 0.642s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c 2G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:28 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c 2G Sep 25 13:47:28 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:28 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb Sep 25 13:47:28 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:28 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb" returned: 0 in 0.498s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:28 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb Sep 25 13:47:28 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:28 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c 2G" returned: 0 in 0.582s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-627f94be-58e1-479d-967a-1a6fff46c5b8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:28 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-627f94be-58e1-479d-967a-1a6fff46c5b8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c Sep 25 13:47:28 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:28 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb" released by "delete_volume" :: held 0.922s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:28 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Created reservations ['6e275406-a95f-40fd-ba83-6620c4677ab6', '3ac17ba9-ff94-4f62-9771-41f9867ba1be', '4d41891e-7fb2-4ab8-b61e-7b6c5ced7b17', '85102b6f-4a1f-436f-b750-4cbc6e1985e1'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:29 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:29 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:29 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-627f94be-58e1-479d-967a-1a6fff46c5b8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c" returned: 0 in 0.550s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:29 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c is being set with open permissions: ugo+rw Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:29 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c Sep 25 13:47:29 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:29 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.343s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-22d88011-bc27-4936-9dad-1a261e6c1443 tempest-VolumesGetTest-272626769 None] Lock "cinder-7f8ffc4a-e553-4840-8f9b-3b67b3ab56eb-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:29 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c" returned: 0 in 0.404s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:29 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info Sep 25 13:47:29 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:30 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:30 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info is being set with open permissions: ugo+rw Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:30 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info Sep 25 13:47:30 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-780b3240-b88c-4152-8bf2-e3a56b264893-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Lock "cinder-780b3240-b88c-4152-8bf2-e3a56b264893-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:30 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-780b3240-b88c-4152-8bf2-e3a56b264893" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.info" returned: 0 in 0.351s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-780b3240-b88c-4152-8bf2-e3a56b264893" acquired by "delete_volume" :: waited 0.068s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2e45256d-ea3a-42bd-9ca6-59b16f001cca tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Create snapshot completed successfully Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d110a9-e8da-4d54-9ce3-db952c91cfa7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:30 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 Sep 25 13:47:30 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:30 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893" returned: 0 in 0.494s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:31 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893 Sep 25 13:47:31 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:31 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-780b3240-b88c-4152-8bf2-e3a56b264893" returned: 0 in 0.361s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-780b3240-b88c-4152-8bf2-e3a56b264893" released by "delete_volume" :: held 0.941s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "cinder-2b7a1728-4ebe-4916-8245-5997b68f081c-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Created reservations ['1b1b09f3-3d4d-49fe-8735-dcea7c265db6', 'a9db7039-082c-4f32-ba39-60cb4474f0b2', 'd3857c1b-1ea0-4ac9-bc3e-1a01813ccfb4', 'b25b9246-997f-4293-817c-c3ae92be8189'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-2b7a1728-4ebe-4916-8245-5997b68f081c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "cinder-quobyte-627f94be-58e1-479d-967a-1a6fff46c5b8" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-quobyte-627f94be-58e1-479d-967a-1a6fff46c5b8" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "cinder-quobyte-2b7a1728-4ebe-4916-8245-5997b68f081c" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-quobyte-2b7a1728-4ebe-4916-8245-5997b68f081c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Deleting offline snapshot 2b7a1728-4ebe-4916-8245-5997b68f081c of volume 627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] snapshot_file for this snap is: volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1972243-a8c4-41a7-90b3-fdb3e4483e9f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:31 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:31 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:31 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c Sep 25 13:47:31 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:32 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.434s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ba444905-5c46-4970-8fb3-f67fbd5639be tempest-VolumesGetTest-272626769 None] Lock "cinder-780b3240-b88c-4152-8bf2-e3a56b264893-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:32 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c" returned: 0 in 0.627s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-627f94be-58e1-479d-967a-1a6fff46c5b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc514f-82c3-47fd-9a39-5abcda552f09]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:32 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 Sep 25 13:47:32 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-0cff11ba-0da3-40e9-8881-8577ba7254e4-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Lock "cinder-0cff11ba-0da3-40e9-8881-8577ba7254e4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-0cff11ba-0da3-40e9-8881-8577ba7254e4" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-0cff11ba-0da3-40e9-8881-8577ba7254e4" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ce27d1-4f5d-4fa4-acd2-48747d28d80a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:33 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8" returned: 0 in 0.741s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:33 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c Sep 25 13:47:33 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:33 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 Sep 25 13:47:33 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:33 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4" returned: 0 in 0.601s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:33 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4 Sep 25 13:47:33 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:33 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c" returned: 0 in 0.599s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:33 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c Sep 25 13:47:33 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:34 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0cff11ba-0da3-40e9-8881-8577ba7254e4" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-0cff11ba-0da3-40e9-8881-8577ba7254e4" released by "delete_volume" :: held 1.141s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:34 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Created reservations ['594f1ca2-1271-4ac3-adb5-54b42619d55b', '85f57c54-f6cc-40ce-b1ab-7fa65f003d72', 'db84b4b0-152d-4ba9-a58b-0718bd97f86a', '26100623-2616-4ea7-ad7d-6949e02e6c4e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8.2b7a1728-4ebe-4916-8245-5997b68f081c" returned: 0 in 0.429s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-quobyte-2b7a1728-4ebe-4916-8245-5997b68f081c" released by "_delete_snapshot" :: held 2.597s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-quobyte-627f94be-58e1-479d-967a-1a6fff46c5b8" released by "delete_snapshot" :: held 2.645s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:34 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:34 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Created reservations ['d40eec25-fa06-4e13-b7f2-6442ad975eb1', '5c3d2041-8d19-4c85-9ab8-b105cfb11233', '7b7e62d8-4306-4417-ac02-12e44f359f48', '9d0f8710-d664-433f-9824-9915bf57bf78'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Delete snapshot completed successfully. Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90bc71ad-fd05-4a89-bc06-14f3cfa569bf tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-2b7a1728-4ebe-4916-8245-5997b68f081c-delete_snapshot" released by "delete_snapshot" :: held 2.921s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:34 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.333s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a639b4b3-0e93-4d63-87dc-c63636407989 tempest-VolumesGetTest-272626769 None] Lock "cinder-0cff11ba-0da3-40e9-8881-8577ba7254e4-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "cinder-627f94be-58e1-479d-967a-1a6fff46c5b8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-627f94be-58e1-479d-967a-1a6fff46c5b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "cinder-quobyte-627f94be-58e1-479d-967a-1a6fff46c5b8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-quobyte-627f94be-58e1-479d-967a-1a6fff46c5b8" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e19daf-e018-4a3c-b064-efa4f0aea3a5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:35 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 Sep 25 13:47:35 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:35 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8" returned: 0 in 0.467s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:35 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8 Sep 25 13:47:35 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:35 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-627f94be-58e1-479d-967a-1a6fff46c5b8" returned: 0 in 0.387s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-quobyte-627f94be-58e1-479d-967a-1a6fff46c5b8" released by "delete_volume" :: held 0.957s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Created reservations ['45e9db3e-dd3d-4e3f-98d8-cb10042fd6cd', '68c5fef9-e551-4127-921e-04a186291c5f', '4d2566ff-64f0-4ff6-8363-5ed7a122260e', 'fe221fc2-ae41-4d12-9067-ddaf1ae164c6'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:36 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:36 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (d08287e5-2510-4c2a-a69c-43b0866ccbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cf9bd4-268f-4219-a72f-2c8ccc4c60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cf9bd4-268f-4219-a72f-2c8ccc4c60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-546592902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09846471-256b-4412-8f37-24667e08d037,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:36Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786c5763-7262-476f-99c4-e665e225a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786c5763-7262-476f-99c4-e665e225a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beaae7c-747f-41b3-87a1-4b4af5cc5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:47:36 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.362s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Deleted volume successfully. Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ebe02ec3-20a3-46f9-8d1a-fe35ee503db7 tempest-VolumesSnapshotNegativeTestJSON-291521518 None] Lock "cinder-627f94be-58e1-479d-967a-1a6fff46c5b8-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beaae7c-747f-41b3-87a1-4b4af5cc5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09846471-256b-4412-8f37-24667e08d037', 'volume_name': 'volume-09846471-256b-4412-8f37-24667e08d037', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70343a62-15ae-4b68-bd1c-a9be8e714efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70343a62-15ae-4b68-bd1c-a9be8e714efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a694fb7f-d1e3-4375-a5bc-97e4c8f61ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:36 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Volume 09846471-256b-4412-8f37-24667e08d037: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09846471-256b-4412-8f37-24667e08d037', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 13:47:36 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Trying to clone 09846471-256b-4412-8f37-24667e08d037 from image a1a28988-676d-4ae6-a228-f7c326723a56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:47:37 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Image download 20.69 MB at 20.69 MB/s Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e559a7d1-d6e5-4ebb-a795-0a2aff4b8ae9]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:37 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD Sep 25 13:47:37 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:37 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 is fetched for user b5271800768f4d248103e4c1183b7335. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e792ee76-d59a-4f99-9666-1978e425aa2a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:38 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD Sep 25 13:47:38 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:38 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-546592902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09846471-256b-4412-8f37-24667e08d037,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:36Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Creating volume 09846471-256b-4412-8f37-24667e08d037 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:38 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:38 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 1073741824 Sep 25 13:47:38 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:39 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 1073741824" returned: 0 in 0.616s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:39 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 Sep 25 13:47:39 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:39 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Attempting download of a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume 09846471-256b-4412-8f37-24667e08d037. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e77d1c-9fc7-4a75-b7d0-4f7346a9c3f6]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:39 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo Sep 25 13:47:39 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:40 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo" returned: 0 in 0.453s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:40 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo Sep 25 13:47:40 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:40 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo" returned: 1 in 0.498s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_ipua99xo' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:47:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f4bf38-0d8f-483a-a4c6-b7bc51143ce3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:40 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD Sep 25 13:47:40 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:41 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:41 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] a1a28988-676d-4ae6-a228-f7c326723a56 was qcow2, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:47:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:41 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 Sep 25 13:47:41 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:43 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037" returned: 0 in 2.737s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:43 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_6y8d965bdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:47:43 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Converted 112.00 MB image at 40.87 MB/s Sep 25 13:47:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:43 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 1G Sep 25 13:47:43 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:44 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 1G" returned: 0 in 0.413s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Downloaded image a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume 09846471-256b-4412-8f37-24667e08d037 successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 for user b5271800768f4d248103e4c1183b7335 is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Marking volume 09846471-256b-4412-8f37-24667e08d037 as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Copying metadata from image a1a28988-676d-4ae6-a228-f7c326723a56 to 09846471-256b-4412-8f37-24667e08d037. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Creating volume glance metadata for volume 09846471-256b-4412-8f37-24667e08d037 backed by image a1a28988-676d-4ae6-a228-f7c326723a56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a694fb7f-d1e3-4375-a5bc-97e4c8f61ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09846471-256b-4412-8f37-24667e08d037', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7951d9d1-7a68-4cd3-8e5b-9b47d96f9938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Volume volume-09846471-256b-4412-8f37-24667e08d037 (09846471-256b-4412-8f37-24667e08d037): created successfully Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7951d9d1-7a68-4cd3-8e5b-9b47d96f9938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (d08287e5-2510-4c2a-a69c-43b0866ccbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3ec3bde8-cab6-43f6-ab26-d6d0a297aebf tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (7615318d-b808-4fe3-99cd-a6256cda3ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c9011c-db46-4042-b8d3-b7734b189e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c9011c-db46-4042-b8d3-b7734b189e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1429231540',display_name='tempest-VolumesGetTest-Volume-451149088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9394d3-dfb1-4964-b721-d33cece80c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:46Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474260c0-7ffa-480a-a13a-172623981fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474260c0-7ffa-480a-a13a-172623981fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1baacb-5a35-4fef-a579-ad2ec84fc459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1baacb-5a35-4fef-a579-ad2ec84fc459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9394d3-dfb1-4964-b721-d33cece80c57', 'volume_name': 'volume-fb9394d3-dfb1-4964-b721-d33cece80c57', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39538bb1-15d1-448b-ae05-20e672ded7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39538bb1-15d1-448b-ae05-20e672ded7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6deba914-c020-41b4-b9e0-f2fa6b5dbf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Volume fb9394d3-dfb1-4964-b721-d33cece80c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9394d3-dfb1-4964-b721-d33cece80c57', 'volume_size': 1} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1429231540',display_name='tempest-VolumesGetTest-Volume-451149088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9394d3-dfb1-4964-b721-d33cece80c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f6d113780486696890d10a745d9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:46Z,use_quota=True,user_id='b5271800768f4d248103e4c1183b7335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Creating volume fb9394d3-dfb1-4964-b721-d33cece80c57 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:46 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:46 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 1073741824 Sep 25 13:47:46 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:46 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 1073741824" returned: 0 in 0.527s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:46 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 Sep 25 13:47:46 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:47 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57" returned: 0 in 0.319s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6deba914-c020-41b4-b9e0-f2fa6b5dbf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9394d3-dfb1-4964-b721-d33cece80c57', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca78f84-529d-44b3-8e9e-b8b965dab82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Volume volume-fb9394d3-dfb1-4964-b721-d33cece80c57 (fb9394d3-dfb1-4964-b721-d33cece80c57): created successfully Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca78f84-529d-44b3-8e9e-b8b965dab82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Flow 'volume_create_manager' (7615318d-b808-4fe3-99cd-a6256cda3ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e379bccc-a80c-4ada-9f62-be816b59290c tempest-VolumesGetTest-272626769 None] Created volume successfully. Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-fb9394d3-dfb1-4964-b721-d33cece80c57-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Lock "cinder-fb9394d3-dfb1-4964-b721-d33cece80c57-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-fb9394d3-dfb1-4964-b721-d33cece80c57" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-fb9394d3-dfb1-4964-b721-d33cece80c57" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc03c33-c3e3-47b8-ad8d-87056afdd559]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:48 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 Sep 25 13:47:48 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:48 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57" returned: 0 in 0.533s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:49 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57 Sep 25 13:47:49 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:49 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9394d3-dfb1-4964-b721-d33cece80c57" returned: 0 in 0.371s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-fb9394d3-dfb1-4964-b721-d33cece80c57" released by "delete_volume" :: held 0.968s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Created reservations ['e9b57fc0-2231-48a1-8918-1bc0b3328f64', 'c1529fba-295c-4a70-a35f-af720ade3f16', '7141829f-66c2-4b13-bea3-fea3d5583c53', '13c25add-3faf-46fc-ad52-d77cbf20dda9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:49 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:49 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:49 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3bc6e2ee-cfc0-40a0-8e56-7c1b70151f91 tempest-VolumesGetTest-272626769 None] Lock "cinder-fb9394d3-dfb1-4964-b721-d33cece80c57-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-09846471-256b-4412-8f37-24667e08d037-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Lock "cinder-09846471-256b-4412-8f37-24667e08d037-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Acquiring lock "cinder-quobyte-09846471-256b-4412-8f37-24667e08d037" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:47:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-09846471-256b-4412-8f37-24667e08d037" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:47:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d394f4-c639-4bd0-8938-5a6df1ebebd3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:47:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:51 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 Sep 25 13:47:51 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:51 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037" returned: 0 in 0.567s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:51 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037 Sep 25 13:47:51 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:52 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-09846471-256b-4412-8f37-24667e08d037" returned: 0 in 0.375s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Lock "cinder-quobyte-09846471-256b-4412-8f37-24667e08d037" released by "delete_volume" :: held 1.058s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Created reservations ['c9671402-fb10-4e3a-910d-3690edba2bf0', '2abef7fe-ed48-496b-b52f-a8746cce7153', '4c28dc56-3632-492d-9e82-c290776048f9', 'c847985a-e4ef-4487-930b-3da11dd25405'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:52 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:47:52 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:52 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:47:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Deleted volume successfully. Sep 25 13:47:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-11f6e43e-cd67-46ea-858f-085af76fa523 tempest-VolumesGetTest-272626769 None] Lock "cinder-09846471-256b-4412-8f37-24667e08d037-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Flow 'volume_create_manager' (231b28f8-1356-42c4-b3e9-ac07e2aef855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24a1e4a-b5e6-4b9f-aec3-50b50d82a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24a1e4a-b5e6-4b9f-aec3-50b50d82a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1161197381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039be43c-9c08-421e-8b75-c58e3f4f6443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13749f31ea748f09f175386dfaafc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:54Z,use_quota=True,user_id='4ee945e5f9be48599611197db96a63e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e1054e-fc44-48a1-9840-6a57d482b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e1054e-fc44-48a1-9840-6a57d482b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5b3da3-6938-4cee-8df0-a936ff056e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5b3da3-6938-4cee-8df0-a936ff056e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '039be43c-9c08-421e-8b75-c58e3f4f6443', 'volume_name': 'volume-039be43c-9c08-421e-8b75-c58e3f4f6443', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981acf87-37e6-4ce3-b478-211022f6e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981acf87-37e6-4ce3-b478-211022f6e81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2affe8d-1236-4c2b-8c07-9b718bf17a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:54 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Volume 039be43c-9c08-421e-8b75-c58e3f4f6443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-039be43c-9c08-421e-8b75-c58e3f4f6443', 'volume_size': 1} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1161197381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039be43c-9c08-421e-8b75-c58e3f4f6443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13749f31ea748f09f175386dfaafc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:54Z,use_quota=True,user_id='4ee945e5f9be48599611197db96a63e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Creating volume 039be43c-9c08-421e-8b75-c58e3f4f6443 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:54 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:54 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 1073741824 Sep 25 13:47:54 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:54 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 1073741824" returned: 0 in 0.731s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:55 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 Sep 25 13:47:55 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:55 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443" returned: 0 in 0.383s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2affe8d-1236-4c2b-8c07-9b718bf17a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-039be43c-9c08-421e-8b75-c58e3f4f6443', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a821ffed-fd65-4a81-8c06-79d02b94ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:55 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Volume volume-039be43c-9c08-421e-8b75-c58e3f4f6443 (039be43c-9c08-421e-8b75-c58e3f4f6443): created successfully Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a821ffed-fd65-4a81-8c06-79d02b94ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Flow 'volume_create_manager' (231b28f8-1356-42c4-b3e9-ac07e2aef855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2778aad1-e768-4709-a38c-71ae21a38dd7 tempest-AttachVolumeTestJSON-1891370425 None] Created volume successfully. Sep 25 13:47:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-93b9a690-0783-4899-ae7a-d7b697b152d7 req-b8852afd-16df-4583-9c66-5efadf54332d tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-93b9a690-0783-4899-ae7a-d7b697b152d7 req-b8852afd-16df-4583-9c66-5efadf54332d tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-93b9a690-0783-4899-ae7a-d7b697b152d7 req-b8852afd-16df-4583-9c66-5efadf54332d tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-93b9a690-0783-4899-ae7a-d7b697b152d7 req-b8852afd-16df-4583-9c66-5efadf54332d tempest-AttachVolumeTestJSON-1891370425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-039be43c-9c08-421e-8b75-c58e3f4f6443', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '707d4337-814e-41ed-a9d5-43454976a40f', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:47:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-93b9a690-0783-4899-ae7a-d7b697b152d7 req-b8852afd-16df-4583-9c66-5efadf54332d tempest-AttachVolumeTestJSON-1891370425 None] attachment_update completed successfully. Sep 25 13:47:58 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:47:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Flow 'volume_create_manager' (14d909cc-6f58-4d3c-9a2b-b0b9d24ecfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:47:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3aebe3-c65e-4816-91d3-3acfc6b20f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3aebe3-c65e-4816-91d3-3acfc6b20f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1210286228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536fed01-1e76-4fa9-996e-3ff54b8b6ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fea3240bb434a71b114a08b52cc4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:59Z,use_quota=True,user_id='b06da45a7c9c49ba94067aad94de6a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f462e59-ac7a-422b-a645-5b5e34eb07cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f462e59-ac7a-422b-a645-5b5e34eb07cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76688448-3b2b-4cb5-8289-c150bde1578d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76688448-3b2b-4cb5-8289-c150bde1578d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536fed01-1e76-4fa9-996e-3ff54b8b6ef6', 'volume_name': 'volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf2fb52-78e2-472e-94f4-df2ab61a59cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf2fb52-78e2-472e-94f4-df2ab61a59cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2fa678-4dc5-4d51-a0c2-b10feb57a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:47:59 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6', 'volume_size': 1} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1210286228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536fed01-1e76-4fa9-996e-3ff54b8b6ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fea3240bb434a71b114a08b52cc4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:47:59Z,use_quota=True,user_id='b06da45a7c9c49ba94067aad94de6a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Creating volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:47:59 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:59 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 1073741824 Sep 25 13:47:59 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:47:59 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 1073741824" returned: 0 in 0.644s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:47:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:47:59 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 Sep 25 13:47:59 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Flow 'volume_create_manager' (6a50c976-665a-4e8c-b39c-b4831902fe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff524d7-4097-48b2-8a59-140b43ec9bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:00 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff524d7-4097-48b2-8a59-140b43ec9bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-634473593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1472d264-d44c-4934-a23f-358ebe1e0c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13749f31ea748f09f175386dfaafc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:00Z,use_quota=True,user_id='4ee945e5f9be48599611197db96a63e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8077de76-ea3d-4b11-9d3a-99f20506dbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8077de76-ea3d-4b11-9d3a-99f20506dbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76925425-e4d2-443d-94ee-093002a4eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76925425-e4d2-443d-94ee-093002a4eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1472d264-d44c-4934-a23f-358ebe1e0c34', 'volume_name': 'volume-1472d264-d44c-4934-a23f-358ebe1e0c34', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d61310c-1f5d-409a-8c81-c5520b93a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d61310c-1f5d-409a-8c81-c5520b93a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af6d9bf-9c0f-4409-9152-0fbcac163f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Volume 1472d264-d44c-4934-a23f-358ebe1e0c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1472d264-d44c-4934-a23f-358ebe1e0c34', 'volume_size': 1} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" returned: 0 in 0.508s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-634473593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1472d264-d44c-4934-a23f-358ebe1e0c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13749f31ea748f09f175386dfaafc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:00Z,use_quota=True,user_id='4ee945e5f9be48599611197db96a63e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Creating volume 1472d264-d44c-4934-a23f-358ebe1e0c34 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:48:00 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2fa678-4dc5-4d51-a0c2-b10feb57a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df951b92-6386-401e-b71c-b101679e2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:00 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 1073741824 Sep 25 13:48:00 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Volume volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 (536fed01-1e76-4fa9-996e-3ff54b8b6ef6): created successfully Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df951b92-6386-401e-b71c-b101679e2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Flow 'volume_create_manager' (14d909cc-6f58-4d3c-9a2b-b0b9d24ecfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-189a24ac-5e1e-44d8-a091-64d586e39816 tempest-VolumesSnapshotListTestJSON-1235239087 None] Created volume successfully. Sep 25 13:48:00 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 1073741824" returned: 0 in 0.612s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:00 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 Sep 25 13:48:01 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:01 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34" returned: 0 in 0.379s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af6d9bf-9c0f-4409-9152-0fbcac163f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1472d264-d44c-4934-a23f-358ebe1e0c34', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ae5131-1027-48c3-8e70-f9f17432a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Creating offline snapshot 27fedac8-6908-4a95-89e2-8d5bbcfcca93 of volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:48:01 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Volume volume-1472d264-d44c-4934-a23f-358ebe1e0c34 (1472d264-d44c-4934-a23f-358ebe1e0c34): created successfully Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ae5131-1027-48c3-8e70-f9f17432a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Flow 'volume_create_manager' (6a50c976-665a-4e8c-b39c-b4831902fe0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[734c153c-8342-4095-a2d6-3e0e57f7d333]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c513c47a-de42-4233-a3ee-bbe4397181e2 tempest-AttachVolumeTestJSON-1891370425 None] Created volume successfully. Sep 25 13:48:01 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 Sep 25 13:48:01 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:01 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" returned: 0 in 0.460s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:01 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 1G Sep 25 13:48:01 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:02 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 1G" returned: 0 in 0.874s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:02 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:02 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:03 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.444s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:03 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 is being set with open permissions: ugo+rw Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:03 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:03 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-17e4c902-c275-4adf-8978-9f4b0d93af06 req-efba46fa-a67f-4611-ba4a-4b990fadbb1c tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:03 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.353s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:03 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info Sep 25 13:48:03 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:03 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info" returned: 0 in 0.339s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:03 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info is being set with open permissions: ugo+rw Sep 25 13:48:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:03 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info Sep 25 13:48:03 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:04 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.info" returned: 0 in 0.328s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-17e4c902-c275-4adf-8978-9f4b0d93af06 req-efba46fa-a67f-4611-ba4a-4b990fadbb1c tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.936s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-17e4c902-c275-4adf-8978-9f4b0d93af06 req-efba46fa-a67f-4611-ba4a-4b990fadbb1c tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9491e4b5-6ea0-48ae-9fcc-f652955f66e4 tempest-VolumesSnapshotListTestJSON-1235239087 None] Create snapshot completed successfully Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-17e4c902-c275-4adf-8978-9f4b0d93af06 req-efba46fa-a67f-4611-ba4a-4b990fadbb1c tempest-AttachVolumeTestJSON-1891370425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-1472d264-d44c-4934-a23f-358ebe1e0c34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '154a52b7-b394-4b55-b6ca-c3f051b2c9f4', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:48:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-17e4c902-c275-4adf-8978-9f4b0d93af06 req-efba46fa-a67f-4611-ba4a-4b990fadbb1c tempest-AttachVolumeTestJSON-1891370425 None] attachment_update completed successfully. Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Creating offline snapshot f039d141-01d6-4441-8d1c-68a16e3d9dc1 of volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:48:05 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e3f3fb-052d-4c38-8c93-f973f654c11d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:05 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:05 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:05 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.543s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:05 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 1G Sep 25 13:48:05 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:06 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 1G" returned: 0 in 0.668s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:06 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:06 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:06 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.430s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:06 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 is being set with open permissions: ugo+rw Sep 25 13:48:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:06 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:06 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:07 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.401s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-788d2fab-c17d-4a33-924a-09a02bc11df7 tempest-VolumesSnapshotListTestJSON-1235239087 None] Create snapshot completed successfully Sep 25 13:48:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-9a923442-d243-42fb-8095-e2e8c1dfb683 req-ea5d37c2-c8eb-404c-8ff0-e88099b0259e tempest-AttachVolumeTestJSON-1891370425 None] Terminate volume connection completed successfully. Sep 25 13:48:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-9a923442-d243-42fb-8095-e2e8c1dfb683 req-ea5d37c2-c8eb-404c-8ff0-e88099b0259e tempest-AttachVolumeTestJSON-1891370425 None] Deleting attachment 707d4337-814e-41ed-a9d5-43454976a40f. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Creating offline snapshot 1a0181da-4706-4e19-bd3d-70185faf8c28 of volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[df019610-c5f2-412a-b226-2487c1442eee]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:08 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:08 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:08 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.584s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:09 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 1G Sep 25 13:48:09 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-1a6637c2-d6de-4bbd-af3b-0f28ad28a960 req-84c65e09-663a-463e-b2b9-7f54f2e46cc2 tempest-AttachVolumeTestJSON-1891370425 None] Terminate volume connection completed successfully. Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-1a6637c2-d6de-4bbd-af3b-0f28ad28a960 req-84c65e09-663a-463e-b2b9-7f54f2e46cc2 tempest-AttachVolumeTestJSON-1891370425 None] Deleting attachment 154a52b7-b394-4b55-b6ca-c3f051b2c9f4. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:48:09 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 1G" returned: 0 in 0.770s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:09 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 Sep 25 13:48:09 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:09 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:48:09 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:10 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.310s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:48:10 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28" returned: 0 in 0.526s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:10 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 is being set with open permissions: ugo+rw Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:10 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 Sep 25 13:48:10 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:10 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28" returned: 0 in 0.369s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ee20da90-a42d-488b-adc3-cf4a6ca20071 tempest-VolumesSnapshotListTestJSON-1235239087 None] Create snapshot completed successfully Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-1a0181da-4706-4e19-bd3d-70185faf8c28-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-1a0181da-4706-4e19-bd3d-70185faf8c28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-1a0181da-4706-4e19-bd3d-70185faf8c28" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-1a0181da-4706-4e19-bd3d-70185faf8c28" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Deleting offline snapshot 1a0181da-4706-4e19-bd3d-70185faf8c28 of volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] snapshot_file for this snap is: volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[da45203d-5049-4ec4-bf1b-afa5c03c3933]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:13 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 Sep 25 13:48:13 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:13 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28" returned: 0 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4581546-fa35-492d-bf0c-042da72987f3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:13 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:13 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:13 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.531s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:14 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 Sep 25 13:48:14 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:14 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28" returned: 0 in 0.674s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:14 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28 Sep 25 13:48:14 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:15 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.1a0181da-4706-4e19-bd3d-70185faf8c28" returned: 0 in 0.421s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-1a0181da-4706-4e19-bd3d-70185faf8c28" released by "_delete_snapshot" :: held 2.260s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" released by "delete_snapshot" :: held 2.297s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:15 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Created reservations ['2d62bd20-f57f-4f2b-9c5f-7df1814e5424', 'c3869177-9adb-45a7-a42f-fd60265e2410', 'f329ac6c-afb1-4ae2-8df0-0cebd50b5644', '9777cda1-aba6-4e5e-a0b5-ad7e678342ea'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Delete snapshot completed successfully. Sep 25 13:48:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-de2da127-6f00-4124-b6a9-c8317e5e2434 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-1a0181da-4706-4e19-bd3d-70185faf8c28-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-f039d141-01d6-4441-8d1c-68a16e3d9dc1-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-f039d141-01d6-4441-8d1c-68a16e3d9dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-f039d141-01d6-4441-8d1c-68a16e3d9dc1" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-f039d141-01d6-4441-8d1c-68a16e3d9dc1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Deleting offline snapshot f039d141-01d6-4441-8d1c-68a16e3d9dc1 of volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] snapshot_file for this snap is: volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5827a6c-9b25-4359-a203-cfa9f03b391c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:16 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:16 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "cinder-1472d264-d44c-4934-a23f-358ebe1e0c34-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:16 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.537s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-1472d264-d44c-4934-a23f-358ebe1e0c34-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[318d03ee-ad02-4290-adcf-b26465e3860b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "cinder-quobyte-1472d264-d44c-4934-a23f-358ebe1e0c34" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-quobyte-1472d264-d44c-4934-a23f-358ebe1e0c34" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[323106a5-edf9-45d9-9a3a-40f2003ff475]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:17 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:17 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Flow 'volume_create_manager' (a053b611-41b9-4e67-83cb-b5c7ac4205c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cc2194-1c81-471a-9b0c-58653621022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cc2194-1c81-471a-9b0c-58653621022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-161992993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90cfc83-5c87-42cb-936d-3291e9bde540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e268921a24635889589774b8782ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:17Z,use_quota=True,user_id='1a9d660b344542d79816642b8405eaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b43bafa-6ba1-4580-814c-b2538ccdb57b),volume_type_id=6b43bafa-6ba1-4580-814c-b2538ccdb57b)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7260ae29-41e3-4f50-881a-18eac120aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7260ae29-41e3-4f50-881a-18eac120aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:17 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 Sep 25 13:48:17 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c76f017-607c-4635-8c2e-90da4fce8bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c76f017-607c-4635-8c2e-90da4fce8bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90cfc83-5c87-42cb-936d-3291e9bde540', 'volume_name': 'volume-a90cfc83-5c87-42cb-936d-3291e9bde540', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010aadbb-e775-46d9-9baa-ca8c3c72b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010aadbb-e775-46d9-9baa-ca8c3c72b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ff1096-fd00-4fe9-9bb7-dbcb2f3157f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:17 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume a90cfc83-5c87-42cb-936d-3291e9bde540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90cfc83-5c87-42cb-936d-3291e9bde540', 'volume_size': 1} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-161992993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90cfc83-5c87-42cb-936d-3291e9bde540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e268921a24635889589774b8782ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:17Z,use_quota=True,user_id='1a9d660b344542d79816642b8405eaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b43bafa-6ba1-4580-814c-b2538ccdb57b),volume_type_id=6b43bafa-6ba1-4580-814c-b2538ccdb57b)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Creating volume a90cfc83-5c87-42cb-936d-3291e9bde540 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:48:17 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:17 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 1073741824 Sep 25 13:48:17 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:17 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.732s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:17 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:17 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:17 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34" returned: 0 in 0.682s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:17 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34 Sep 25 13:48:17 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:17 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Flow 'volume_create_manager' (9b94bfff-c9bf-429b-b182-04cdb1f3e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:18 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b410a4bb-2abe-41bb-aa1f-0450d1a4810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 1073741824" returned: 0 in 0.765s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b410a4bb-2abe-41bb-aa1f-0450d1a4810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1686051035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267129d0-4b1f-4c50-ab26-7e57c3e574e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e268921a24635889589774b8782ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:18Z,use_quota=True,user_id='1a9d660b344542d79816642b8405eaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3136deb-3669-4ed8-b3f7-f084c6d0a356),volume_type_id=d3136deb-3669-4ed8-b3f7-f084c6d0a356)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816610ba-1fb2-4a92-a584-a51444805e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816610ba-1fb2-4a92-a584-a51444805e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fe744e-b6e2-4865-8de0-5d5db6c3eaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fe744e-b6e2-4865-8de0-5d5db6c3eaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267129d0-4b1f-4c50-ab26-7e57c3e574e8', 'volume_name': 'volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13a672e-71a2-4ec0-afa3-e985051f1bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13a672e-71a2-4ec0-afa3-e985051f1bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33abab8-969f-4506-b244-64469f42ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:18 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume 267129d0-4b1f-4c50-ab26-7e57c3e574e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8', 'volume_size': 1} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:18 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 Sep 25 13:48:18 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:18 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1472d264-d44c-4934-a23f-358ebe1e0c34" returned: 0 in 0.544s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:18 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.711s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-quobyte-1472d264-d44c-4934-a23f-358ebe1e0c34" released by "delete_volume" :: held 1.333s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:18 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1 Sep 25 13:48:18 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Created reservations ['1c716473-c253-478c-8cf6-13c9ad469afb', 'c6d6f871-70d1-4c6f-be2e-dc4f2b48fb9f', '6b6d7bf8-ffc5-4e75-8703-8f013bbcf83a', '348783dc-c82f-4a3f-bb97-b07264370259'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:18 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:48:18 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:18 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1686051035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267129d0-4b1f-4c50-ab26-7e57c3e574e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e268921a24635889589774b8782ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:18Z,use_quota=True,user_id='1a9d660b344542d79816642b8405eaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3136deb-3669-4ed8-b3f7-f084c6d0a356),volume_type_id=d3136deb-3669-4ed8-b3f7-f084c6d0a356)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Creating volume 267129d0-4b1f-4c50-ab26-7e57c3e574e8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:48:18 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:18 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.f039d141-01d6-4441-8d1c-68a16e3d9dc1" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:18 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 1073741824 Sep 25 13:48:18 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ff1096-fd00-4fe9-9bb7-dbcb2f3157f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90cfc83-5c87-42cb-936d-3291e9bde540', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9d6fc7-371c-4ae3-b871-e80a8a234f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-f039d141-01d6-4441-8d1c-68a16e3d9dc1" released by "_delete_snapshot" :: held 2.644s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" released by "delete_snapshot" :: held 2.684s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:18 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume volume-a90cfc83-5c87-42cb-936d-3291e9bde540 (a90cfc83-5c87-42cb-936d-3291e9bde540): created successfully Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9d6fc7-371c-4ae3-b871-e80a8a234f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Flow 'volume_create_manager' (a053b611-41b9-4e67-83cb-b5c7ac4205c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1722c11b-02f1-4cdf-9fdf-abd3b25f7a17 tempest-TestInstancesWithCinderVolumes-1755023412 None] Created volume successfully. Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Created reservations ['e27f4238-60c2-452d-a819-55135b697068', 'f42b322e-3cb0-44aa-b565-612b3ce43269', '53d406c2-c8a4-4e1e-a2d0-d9944275b0d0', '54ec2c3b-8cde-4d1d-9701-736b935d8009'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:19 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.503s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:48:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Deleted volume successfully. Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a6d2f7c6-72b0-4bb2-ad2e-7e10b49a847b tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-1472d264-d44c-4934-a23f-358ebe1e0c34-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Delete snapshot completed successfully. Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-70e4f263-b2bf-41d2-b71b-36e1c8775765 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-f039d141-01d6-4441-8d1c-68a16e3d9dc1-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "cinder-039be43c-9c08-421e-8b75-c58e3f4f6443-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-039be43c-9c08-421e-8b75-c58e3f4f6443-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Flow 'volume_create_manager' (5eaa5791-b13a-4c91-aabc-2f1cc60391f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca747c7a-a472-4798-b391-eb8c9593d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca747c7a-a472-4798-b391-eb8c9593d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-500548113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c07990-a614-40d7-adba-9d39763359a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e268921a24635889589774b8782ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:19Z,use_quota=True,user_id='1a9d660b344542d79816642b8405eaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(888bafaa-0c99-4c5a-a2bb-5f5e9659845d),volume_type_id=888bafaa-0c99-4c5a-a2bb-5f5e9659845d)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83426707-aa5c-4752-8a85-978f9692f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83426707-aa5c-4752-8a85-978f9692f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d78f7bb-8f9d-4f0f-abe9-5435081a7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-27fedac8-6908-4a95-89e2-8d5bbcfcca93-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "cinder-quobyte-039be43c-9c08-421e-8b75-c58e3f4f6443" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-27fedac8-6908-4a95-89e2-8d5bbcfcca93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-quobyte-039be43c-9c08-421e-8b75-c58e3f4f6443" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:19 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 1073741824" returned: 0 in 0.822s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[44952386-4d5b-4210-b01b-f173de5e93c0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-27fedac8-6908-4a95-89e2-8d5bbcfcca93" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-27fedac8-6908-4a95-89e2-8d5bbcfcca93" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Deleting offline snapshot 27fedac8-6908-4a95-89e2-8d5bbcfcca93 of volume 536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] snapshot_file for this snap is: volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[667f4df1-c5f9-4a6b-9bbe-e12caf51fbbd]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:19 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 Sep 25 13:48:19 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:19 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 Sep 25 13:48:19 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d78f7bb-8f9d-4f0f-abe9-5435081a7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68c07990-a614-40d7-adba-9d39763359a8', 'volume_name': 'volume-68c07990-a614-40d7-adba-9d39763359a8', 'volume_size': 1, 'image_id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b44ac45-8d10-4836-930d-f02f571bb0d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--265885908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '183e268921a24635889589774b8782ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'created_at': datetime.datetime(2026, 9, 25, 11, 48, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b44ac45-8d10-4836-930d-f02f571bb0d0/file', 'properties': {}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:19 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:19 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a0f086-31c1-4847-95f1-68f1322dfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a0f086-31c1-4847-95f1-68f1322dfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f32578-96e3-4c35-a5b2-59f8dd869b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:19 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume 68c07990-a614-40d7-adba-9d39763359a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68c07990-a614-40d7-adba-9d39763359a8', 'volume_size': 1, 'image_id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b44ac45-8d10-4836-930d-f02f571bb0d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--265885908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '183e268921a24635889589774b8782ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'created_at': datetime.datetime(2026, 9, 25, 11, 48, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b44ac45-8d10-4836-930d-f02f571bb0d0/file', 'properties': {}}, 'image_service': } Sep 25 13:48:19 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Trying to clone 68c07990-a614-40d7-adba-9d39763359a8 from image 3b44ac45-8d10-4836-930d-f02f571bb0d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b44ac45-8d10-4836-930d-f02f571bb0d0', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:48:20 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:20 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443" returned: 0 in 0.539s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33abab8-969f-4506-b244-64469f42ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbc9706-8333-4d0f-a4a6-f7cd40db2da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:20 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443 Sep 25 13:48:20 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=119,cinder:SELECT=111,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:48:20 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 (267129d0-4b1f-4c50-ab26-7e57c3e574e8): created successfully Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbc9706-8333-4d0f-a4a6-f7cd40db2da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Flow 'volume_create_manager' (9b94bfff-c9bf-429b-b182-04cdb1f3e7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=108,cinder:SELECT=99,cinder:INSERT=34,cinder:DELETE=11 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:48:20 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5bee2ba1-f562-4724-bc88-0983bbded80f tempest-TestInstancesWithCinderVolumes-1755023412 None] Created volume successfully. Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.574s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a95e628-dd59-4f8c-8e41-0a956c0377ec]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:20 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 Sep 25 13:48:20 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:20 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-039be43c-9c08-421e-8b75-c58e3f4f6443" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-quobyte-039be43c-9c08-421e-8b75-c58e3f4f6443" released by "delete_volume" :: held 1.022s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Created reservations ['b8282cd6-9ce7-4dc3-bc5e-6929a1298ea5', '9cc6e53b-5995-4546-b21e-9ab0fd441da3', 'a201fbd7-f217-453d-8914-4d1544c8db6c', '486462da-fd82-49dc-9b59-0762f59d66eb'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:20 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:20 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:48:20 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:20 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:20 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:20 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.287s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:20 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:48:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Deleted volume successfully. Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2e3308a4-ce5b-40d7-8f89-b579eaf3c504 tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-039be43c-9c08-421e-8b75-c58e3f4f6443-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:21 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.438s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:21 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93 Sep 25 13:48:21 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:21 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6.27fedac8-6908-4a95-89e2-8d5bbcfcca93" returned: 0 in 0.275s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-27fedac8-6908-4a95-89e2-8d5bbcfcca93" released by "_delete_snapshot" :: held 1.888s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" released by "delete_snapshot" :: held 1.941s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Created reservations ['35dcab18-3ffd-4cf1-90d2-fab71f89f7b2', 'c618f6a5-156e-4a2a-a102-420ac8f584c4', 'b35e177f-82f9-4043-9cff-f3cda76f441f', 'cd6d0e13-0aa8-448f-be55-ed6586cfe33b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Delete snapshot completed successfully. Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0c3f0667-660a-4e73-b958-88e87233263d tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-27fedac8-6908-4a95-89e2-8d5bbcfcca93-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "cinder-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "cinder-quobyte-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-quobyte-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e187ecb-2e47-44a6-93dc-4a011a27d528]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:21 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 Sep 25 13:48:21 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:22 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7" returned: 0 in 0.442s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:22 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7 Sep 25 13:48:22 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:22 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7" returned: 0 in 0.310s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-quobyte-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7" released by "delete_volume" :: held 0.810s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Created reservations ['e9a201a1-8838-4d5a-ade4-38e2fb79ba6b', '4e1af595-db95-48a2-b8f5-52c562b5fb43', '5bf20295-44cd-4b8b-89ba-833849fd342f', 'cb0ba099-2aa8-498d-aca1-8b10b0839c21'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-536fed01-1e76-4fa9-996e-3ff54b8b6ef6-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-536fed01-1e76-4fa9-996e-3ff54b8b6ef6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:22 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:48:22 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a68218-a4db-4ce6-85a1-171dedb9538d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:23 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 Sep 25 13:48:23 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:23 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.601s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:48:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Deleted volume successfully. Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62db302f-0c03-4d5a-95a6-91f9e5bcb6be tempest-AttachVolumeTestJSON-1891370425 None] Lock "cinder-4ab47f4a-123e-4e4c-8f52-d2ca76eff5b7-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:23 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" returned: 0 in 0.606s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:23 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6 Sep 25 13:48:23 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:23 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" returned: 0 in 0.342s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-quobyte-536fed01-1e76-4fa9-996e-3ff54b8b6ef6" released by "delete_volume" :: held 1.050s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Created reservations ['b14f2e3e-09f3-440b-8d4d-016c2eb25f02', '18c7bea0-6fb8-4e02-8f52-59a1ccf33b97', 'a3b582c7-83b0-4662-bc9b-71d8760baac3', '2a6b76aa-80a4-4073-9ce9-2552162700ab'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:24 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:48:24 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:24 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.306s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:48:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Deleted volume successfully. Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3695bd1f-94c0-4a9e-8430-ea6ddb7738c0 tempest-VolumesSnapshotListTestJSON-1235239087 None] Lock "cinder-536fed01-1e76-4fa9-996e-3ff54b8b6ef6-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD, size 20.69 MB, duration 4.84 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:48:24 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Image download 20.69 MB at 4.27 MB/s Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[525bd6a8-5521-453b-b021-88df30ce90aa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:24 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD Sep 25 13:48:24 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:25 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Temporary image 3b44ac45-8d10-4836-930d-f02f571bb0d0 is fetched for user 1a9d660b344542d79816642b8405eaae. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf90655c-1434-417e-a885-ff954992ee9f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:25 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD Sep 25 13:48:25 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:25 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-500548113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c07990-a614-40d7-adba-9d39763359a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e268921a24635889589774b8782ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:19Z,use_quota=True,user_id='1a9d660b344542d79816642b8405eaae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(888bafaa-0c99-4c5a-a2bb-5f5e9659845d),volume_type_id=888bafaa-0c99-4c5a-a2bb-5f5e9659845d)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Creating volume 68c07990-a614-40d7-adba-9d39763359a8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:48:25 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:48:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:25 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 1073741824 Sep 25 13:48:25 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:26 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 1073741824" returned: 0 in 0.618s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:26 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 Sep 25 13:48:26 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8" returned: 0 in 0.420s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:26 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Attempting download of 3b44ac45-8d10-4836-930d-f02f571bb0d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3b44ac45-8d10-4836-930d-f02f571bb0d0', 'metadata': {}}])) to volume 68c07990-a614-40d7-adba-9d39763359a8. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7186aa5c-07a7-4443-bc8f-75678c7e67e5]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:27 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac Sep 25 13:48:27 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:27 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac" returned: 0 in 0.476s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:27 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac Sep 25 13:48:27 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:27 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac" returned: 1 in 0.419s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b44ac45-8d10-4836-930d-f02f571bb0d0_fby6_wac' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:48:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc229a7-aeea-4e24-819e-b4f035347143]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:27 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD Sep 25 13:48:27 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:28 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:28 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] 3b44ac45-8d10-4836-930d-f02f571bb0d0 was qcow2, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:48:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:28 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 Sep 25 13:48:28 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:31 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8" returned: 0 in 2.843s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b44ac45-8d10-4836-930d-f02f571bb0d0__kn_xssgdevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:48:31 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Converted 112.00 MB image at 39.36 MB/s Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:31 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 1G Sep 25 13:48:31 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:31 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 1G" returned: 0 in 0.401s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Downloaded image 3b44ac45-8d10-4836-930d-f02f571bb0d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3b44ac45-8d10-4836-930d-f02f571bb0d0', 'metadata': {}}])) to volume 68c07990-a614-40d7-adba-9d39763359a8 successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Temporary image 3b44ac45-8d10-4836-930d-f02f571bb0d0 for user 1a9d660b344542d79816642b8405eaae is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Marking volume 68c07990-a614-40d7-adba-9d39763359a8 as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Copying metadata from image 3b44ac45-8d10-4836-930d-f02f571bb0d0 to 68c07990-a614-40d7-adba-9d39763359a8. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Creating volume glance metadata for volume 68c07990-a614-40d7-adba-9d39763359a8 backed by image 3b44ac45-8d10-4836-930d-f02f571bb0d0 with: {'image_id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'image_name': 'tempest-scenario-img--265885908', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f32578-96e3-4c35-a5b2-59f8dd869b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c07990-a614-40d7-adba-9d39763359a8', 'volume_size': 1, 'image_id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b44ac45-8d10-4836-930d-f02f571bb0d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--265885908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '183e268921a24635889589774b8782ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3b44ac45-8d10-4836-930d-f02f571bb0d0', 'created_at': datetime.datetime(2026, 9, 25, 11, 48, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 48, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b44ac45-8d10-4836-930d-f02f571bb0d0/file', 'properties': {}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea730693-ef77-48f5-bc6d-dde418e1fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:31 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Volume volume-68c07990-a614-40d7-adba-9d39763359a8 (68c07990-a614-40d7-adba-9d39763359a8): created successfully Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea730693-ef77-48f5-bc6d-dde418e1fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Flow 'volume_create_manager' (5eaa5791-b13a-4c91-aabc-2f1cc60391f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-dbef977e-a5f5-4014-a871-d85e6b7022f9 tempest-TestInstancesWithCinderVolumes-1755023412 None] Created volume successfully. Sep 25 13:48:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3d8d62b9-ad78-4957-a920-9b3c18595fc4 tempest-GroupSnapshotsTest-95560471 None] Group tempest-GroupSnapshotsTest-Group-780512954: creating Sep 25 13:48:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3d8d62b9-ad78-4957-a920-9b3c18595fc4 tempest-GroupSnapshotsTest-95560471 None] Group tempest-GroupSnapshotsTest-Group-780512954: created successfully Sep 25 13:48:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3d8d62b9-ad78-4957-a920-9b3c18595fc4 tempest-GroupSnapshotsTest-95560471 None] Create group completed successfully. Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-9a86893f-191c-4fda-a970-42e33cd04261 req-1f51ceba-276d-449c-b282-3f4b67d44839 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-9a86893f-191c-4fda-a970-42e33cd04261 req-1f51ceba-276d-449c-b282-3f4b67d44839 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-9a86893f-191c-4fda-a970-42e33cd04261 req-1f51ceba-276d-449c-b282-3f4b67d44839 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-9a86893f-191c-4fda-a970-42e33cd04261 req-1f51ceba-276d-449c-b282-3f4b67d44839 tempest-TestInstancesWithCinderVolumes-1755023412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-68c07990-a614-40d7-adba-9d39763359a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8fcc3ae-3075-4c62-bb64-180274ce83e7', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:48:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-9a86893f-191c-4fda-a970-42e33cd04261 req-1f51ceba-276d-449c-b282-3f4b67d44839 tempest-TestInstancesWithCinderVolumes-1755023412 None] attachment_update completed successfully. Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (b04c793f-a3b5-48bb-b821-1f843165b0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35be01db-4be8-4df1-8ae6-932ad22c26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35be01db-4be8-4df1-8ae6-932ad22c26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543873221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ead2fbad-596f-4148-9fd3-bd233b90da82,host='devstack@QuobyteHD#QuobyteHD',id=7002d26b-c264-4680-8da1-ad075c7e43fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:37Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9451d74-460a-468c-8e7a-0cfe403094f4),volume_type_id=d9451d74-460a-468c-8e7a-0cfe403094f4)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e56fa71-23d1-4c28-abec-0d29f6ebf068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e56fa71-23d1-4c28-abec-0d29f6ebf068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7138e88-09c1-4d23-a500-c5edf02589ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7138e88-09c1-4d23-a500-c5edf02589ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7002d26b-c264-4680-8da1-ad075c7e43fe', 'volume_name': 'volume-7002d26b-c264-4680-8da1-ad075c7e43fe', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee34c523-3412-4886-882f-2618b33275c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee34c523-3412-4886-882f-2618b33275c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4718d6-f549-4321-87ba-390d6a596aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:37 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Volume 7002d26b-c264-4680-8da1-ad075c7e43fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7002d26b-c264-4680-8da1-ad075c7e43fe', 'volume_size': 1} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ead2fbad-596f-4148-9fd3-bd233b90da82,created_at=2026-09-25T11:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543873221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ead2fbad-596f-4148-9fd3-bd233b90da82,host='devstack@QuobyteHD#QuobyteHD',id=7002d26b-c264-4680-8da1-ad075c7e43fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:48:37Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9451d74-460a-468c-8e7a-0cfe403094f4),volume_type_id=d9451d74-460a-468c-8e7a-0cfe403094f4)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Creating volume 7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:48:37 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:37 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe 1073741824 Sep 25 13:48:37 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:37 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe 1073741824" returned: 0 in 0.652s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:37 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe Sep 25 13:48:37 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:38 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe" returned: 0 in 0.380s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4718d6-f549-4321-87ba-390d6a596aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7002d26b-c264-4680-8da1-ad075c7e43fe', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be59f999-1bc8-44a3-943b-d9a6b948e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:48:38 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Volume volume-7002d26b-c264-4680-8da1-ad075c7e43fe (7002d26b-c264-4680-8da1-ad075c7e43fe): created successfully Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be59f999-1bc8-44a3-943b-d9a6b948e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:48:38 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (b04c793f-a3b5-48bb-b821-1f843165b0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:48:38 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3e5cf61e-e490-4764-95b7-d3430cbd21e2 tempest-GroupSnapshotsTest-95560471 None] Created volume successfully. Sep 25 13:48:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] GroupSnapshot fee8786e-59ec-4ae9-ba99-67dea5bd9fd1: creating. Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Group snapshot fee8786e-59ec-4ae9-ba99-67dea5bd9fd1: creating. {{(pid=87220) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Creating offline snapshot df396f03-807e-4e35-b77e-85b8fa063b08 of volume 7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0227bc6f-7118-4dfa-9ad2-dfc1676bd367]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:40 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe Sep 25 13:48:40 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:40 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe" returned: 0 in 0.531s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:40 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 1G Sep 25 13:48:40 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:41 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 1G" returned: 0 in 0.645s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7002d26b-c264-4680-8da1-ad075c7e43fe -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:41 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7002d26b-c264-4680-8da1-ad075c7e43fe -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 Sep 25 13:48:41 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:41 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7002d26b-c264-4680-8da1-ad075c7e43fe -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08" returned: 0 in 0.538s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:41 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:48:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:41 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 Sep 25 13:48:41 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:42 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:42 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info Sep 25 13:48:42 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:42 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info" returned: 0 in 0.397s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:42 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:48:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:42 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info Sep 25 13:48:42 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:43 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.info" returned: 0 in 0.456s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ce2f90d6-bf6c-42b6-96de-a114de411258 tempest-GroupSnapshotsTest-95560471 None] group_snapshot fee8786e-59ec-4ae9-ba99-67dea5bd9fd1: created successfully Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-df396f03-807e-4e35-b77e-85b8fa063b08-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-df396f03-807e-4e35-b77e-85b8fa063b08-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Creating volume a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce from snapshot df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] snapshot: df396f03-807e-4e35-b77e-85b8fa063b08, volume: a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[169144c7-857a-42c9-bc06-998170163b12]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:46 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 Sep 25 13:48:46 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:46 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08" returned: 0 in 0.692s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7002d26b-c264-4680-8da1-ad075c7e43fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:48:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0cec99-ceb1-4618-928a-7a72c16ca5db]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:48:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:46 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe Sep 25 13:48:46 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:47 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe" returned: 0 in 0.637s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:48:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:48:47 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:48:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:47 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce Sep 25 13:48:47 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:55 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:DELETE=5,cinder:SELECT=42,cinder:INSERT=13,cinder:UPDATE=39 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:48:55 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=47,cinder:INSERT=15,cinder:UPDATE=42,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:48:58 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" returned: 0 in 11.124s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe, size 1024.00 MB, duration 11.12 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:48:58 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Converted 1024.00 MB image at 92.05 MB/s Sep 25 13:48:58 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:48:58 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce Sep 25 13:48:58 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:48:58 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" returned: 0 in 0.443s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" released by "_copy_volume_from_snapshot" :: held 13.081s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-df396f03-807e-4e35-b77e-85b8fa063b08-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" released by "_create_volume_from_snapshot" :: held 13.207s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:48:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.244s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:48:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9d807d7d-7e28-4d38-9cf1-649a1181f3a0 tempest-GroupSnapshotsTest-95560471 None] Create group from source-snapshot-fee8786e-59ec-4ae9-ba99-67dea5bd9fd1 completed successfully. Sep 25 13:49:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f27bfb3-439d-4d43-8f0c-b24f121f1421]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:01 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce Sep 25 13:49:01 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:01 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" returned: 0 in 0.948s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:01 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce Sep 25 13:49:01 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:02 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" returned: 0 in 0.378s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-a8aa8c5b-2ff1-40ac-ae7d-0ffcab1eabce" released by "delete_volume" :: held 1.425s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Created reservations ['12ab2641-530b-4cb8-8836-3059fa457b5e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:02 devstack cinder-volume[87220]: WARNING cinder.quota [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1841540647 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1841540647, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:02 devstack cinder-volume[87220]: WARNING cinder.quota [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1841540647 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1841540647, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Created reservations ['f46165a8-0e2c-44bd-8037-679ef57db370', 'b698628d-dfa8-43d5-91c3-fe984ddc0426', '6403ca40-87dd-4158-bfb1-ad0b036ecbfc', '6484d838-f628-4896-876c-94dab9e2b0ab'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:02 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:49:02 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:03 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:49:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-16bc3e9d-4ea6-4ce3-aa4c-92c2ff1e998d tempest-GroupSnapshotsTest-95560471 None] Delete group completed successfully. Sep 25 13:49:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] group_snapshot fee8786e-59ec-4ae9-ba99-67dea5bd9fd1: deleting Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] group_snapshot fee8786e-59ec-4ae9-ba99-67dea5bd9fd1: deleting {{(pid=87220) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-7002d26b-c264-4680-8da1-ad075c7e43fe" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-7002d26b-c264-4680-8da1-ad075c7e43fe" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-df396f03-807e-4e35-b77e-85b8fa063b08" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-df396f03-807e-4e35-b77e-85b8fa063b08" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Deleting offline snapshot df396f03-807e-4e35-b77e-85b8fa063b08 of volume 7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] snapshot_file for this snap is: volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fd846f-b11f-471f-881d-925fa9f89ce0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:04 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 Sep 25 13:49:04 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:04 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08" returned: 0 in 0.719s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7002d26b-c264-4680-8da1-ad075c7e43fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:49:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c7976-958c-4e11-a8e7-07a278a5c972]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:04 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe Sep 25 13:49:04 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:05 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe" returned: 0 in 0.895s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:05 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 Sep 25 13:49:05 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:06 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08" returned: 0 in 0.548s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:06 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08 Sep 25 13:49:06 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:06 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe.df396f03-807e-4e35-b77e-85b8fa063b08" returned: 0 in 0.625s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-df396f03-807e-4e35-b77e-85b8fa063b08" released by "_delete_snapshot" :: held 3.089s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-7002d26b-c264-4680-8da1-ad075c7e43fe" released by "delete_snapshot" :: held 3.170s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:07 devstack cinder-volume[87220]: WARNING cinder.quota [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1841540647 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1841540647, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['44258208-72c3-4310-889e-a5e1628a6075', '5e9f3083-62fb-4297-b528-c025a808a9be', '91dae9c9-dab7-4ed9-8ece-723269de0a5d', '12b703a1-09fa-4659-8ca1-45a5402de427'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Flow 'volume_create_manager' (a8927cf2-2f94-4dd9-8ecf-9ce3cdb51fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a409e-a34b-460b-9f20-dbccf34e4d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a409e-a34b-460b-9f20-dbccf34e4d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1074949347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54a0447-bd2f-463d-b622-c7d6048230bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed9629ed6494a058aced81e8f41d5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:49:07Z,use_quota=True,user_id='04674d1d901c4eaa847e4634930cbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6051e987-61df-494a-9061-87a5694219db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6051e987-61df-494a-9061-87a5694219db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0303634-68f0-4881-945e-674f544076e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0303634-68f0-4881-945e-674f544076e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54a0447-bd2f-463d-b622-c7d6048230bf', 'volume_name': 'volume-c54a0447-bd2f-463d-b622-c7d6048230bf', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43017a-7001-4f2d-88ca-a437a331134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43017a-7001-4f2d-88ca-a437a331134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80abfe2b-8144-44ac-b6dd-485d31539b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:07 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Volume c54a0447-bd2f-463d-b622-c7d6048230bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54a0447-bd2f-463d-b622-c7d6048230bf', 'volume_size': 1} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1074949347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54a0447-bd2f-463d-b622-c7d6048230bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed9629ed6494a058aced81e8f41d5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:49:07Z,use_quota=True,user_id='04674d1d901c4eaa847e4634930cbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Creating volume c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:49:07 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:49:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e66f8a76-ca78-4376-8033-d4e9a2952be1 tempest-GroupSnapshotsTest-95560471 None] group_snapshot fee8786e-59ec-4ae9-ba99-67dea5bd9fd1: deleted successfully Sep 25 13:49:07 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf 1073741824 Sep 25 13:49:07 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:08 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf 1073741824" returned: 0 in 0.700s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:08 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf Sep 25 13:49:08 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:08 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf" returned: 0 in 0.314s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80abfe2b-8144-44ac-b6dd-485d31539b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54a0447-bd2f-463d-b622-c7d6048230bf', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1b6c10-c4bc-4f15-a50a-2734b451817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Volume volume-c54a0447-bd2f-463d-b622-c7d6048230bf (c54a0447-bd2f-463d-b622-c7d6048230bf): created successfully Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1b6c10-c4bc-4f15-a50a-2734b451817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Flow 'volume_create_manager' (a8927cf2-2f94-4dd9-8ecf-9ce3cdb51fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:49:08 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4a8558cc-e10f-416b-af1a-91f9bcd96311 tempest-TestImageHashVerification-1890905590 None] Created volume successfully. Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-7002d26b-c264-4680-8da1-ad075c7e43fe" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-7002d26b-c264-4680-8da1-ad075c7e43fe" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[efede203-64b4-4e76-8311-de8bde23e352]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:09 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe Sep 25 13:49:09 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:09 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe" returned: 0 in 0.476s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:09 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe Sep 25 13:49:09 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:09 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7002d26b-c264-4680-8da1-ad075c7e43fe" returned: 0 in 0.449s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-7002d26b-c264-4680-8da1-ad075c7e43fe" released by "delete_volume" :: held 1.028s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:09 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:49:09 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['5b1d249d-36a0-486c-9729-8e32bf3fa135'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:10 devstack cinder-volume[87220]: WARNING cinder.db.api [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1841540647'] Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['74931249-d69d-41c9-a118-a1283c5d06b8', '60779aa1-c54f-41fe-a496-d7593464f257', 'f25813e2-b4b2-4e42-b23f-097f71ab1be9', '9968f6c4-88ef-47ef-8558-262abc86f6db'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:10 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:49:10 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:10 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.411s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:49:10 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.389s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-00869079-2c0c-4ff3-8061-8171f03c9ae0 tempest-GroupSnapshotsTest-95560471 None] Delete group completed successfully. Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c248f3-3ccf-4d46-ab7b-70ea4f64adec]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:10 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf Sep 25 13:49:10 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-538a6a29-aea7-4bac-af9a-077993d8ff2b tempest-GroupSnapshotsTest-95560471 None] Group tempest-GroupSnapshotsTest-Group-1872526366: creating Sep 25 13:49:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-538a6a29-aea7-4bac-af9a-077993d8ff2b tempest-GroupSnapshotsTest-95560471 None] Group tempest-GroupSnapshotsTest-Group-1872526366: created successfully Sep 25 13:49:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-538a6a29-aea7-4bac-af9a-077993d8ff2b tempest-GroupSnapshotsTest-95560471 None] Create group completed successfully. Sep 25 13:49:11 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:11 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e5bb38-19e7-4c48-a56b-1a08075d712e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:11 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf Sep 25 13:49:11 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:11 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf" returned: 0 in 0.396s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf /opt/stack/data/cinder/conversion/c54a0447-bd2f-463d-b622-c7d6048230bf.temp_image.187aa590-f7e7-4448-85e6-9c18862c7fecqp86zeb7.img {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:11 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf /opt/stack/data/cinder/conversion/c54a0447-bd2f-463d-b622-c7d6048230bf.temp_image.187aa590-f7e7-4448-85e6-9c18862c7fecqp86zeb7.img Sep 25 13:49:11 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (8a59ebfb-a586-429f-bb4b-83bf8f36d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d98e0c2-d3ee-466e-baef-20b7c2b62fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d98e0c2-d3ee-466e-baef-20b7c2b62fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178892959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eeb9c40-06be-4c8a-b8a3-4b46026d7e17,host='devstack@QuobyteHD#QuobyteHD',id=543e4b7c-f611-45f6-a3bd-86126d6441b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:49:13Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d804d5-8434-4b7c-a6c2-da5b5b6ffc89),volume_type_id=85d804d5-8434-4b7c-a6c2-da5b5b6ffc89)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bfbf2f-ae4d-48a7-bca3-c3bf6d7e175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bfbf2f-ae4d-48a7-bca3-c3bf6d7e175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0b9da-d6cc-4800-9fe0-24afa67622e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0b9da-d6cc-4800-9fe0-24afa67622e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543e4b7c-f611-45f6-a3bd-86126d6441b3', 'volume_name': 'volume-543e4b7c-f611-45f6-a3bd-86126d6441b3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa19921e-e8c5-40a8-a6ff-34e89f313ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa19921e-e8c5-40a8-a6ff-34e89f313ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8615b16-da8d-46f2-951d-348d24d78c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:13 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Volume 543e4b7c-f611-45f6-a3bd-86126d6441b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543e4b7c-f611-45f6-a3bd-86126d6441b3', 'volume_size': 1} Sep 25 13:49:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:18 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf /opt/stack/data/cinder/conversion/c54a0447-bd2f-463d-b622-c7d6048230bf.temp_image.187aa590-f7e7-4448-85e6-9c18862c7fecqp86zeb7.img" returned: 0 in 6.723s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e6790-84dc-4c42-a454-1d036f71fb16]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:18 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf Sep 25 13:49:18 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:18 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf" returned: 0 in 0.635s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:18 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/conversion/c54a0447-bd2f-463d-b622-c7d6048230bf.temp_image.187aa590-f7e7-4448-85e6-9c18862c7fecqp86zeb7.img {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:49:18 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Converted 1024.00 MB image at 152.27 MB/s Sep 25 13:49:18 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] 187aa590-f7e7-4448-85e6-9c18862c7fec was raw, no need to convert to raw {{(pid=87220) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 13:49:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-22dc7592-1a65-47c6-a40f-b82697b77e72 req-b4d334b6-8004-4a47-8dcc-de37e5071e97 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:28 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=39,cinder:SELECT=29,cinder:INSERT=7 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:49:30 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.808s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Uploaded volume to glance image-id: 187aa590-f7e7-4448-85e6-9c18862c7fec. {{(pid=87220) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.150s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1eeb9c40-06be-4c8a-b8a3-4b46026d7e17,created_at=2026-09-25T11:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178892959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eeb9c40-06be-4c8a-b8a3-4b46026d7e17,host='devstack@QuobyteHD#QuobyteHD',id=543e4b7c-f611-45f6-a3bd-86126d6441b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:49:13Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d804d5-8434-4b7c-a6c2-da5b5b6ffc89),volume_type_id=85d804d5-8434-4b7c-a6c2-da5b5b6ffc89)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Creating volume 543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:49:39 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:49:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:39 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 1073741824 Sep 25 13:49:39 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-18f987af-312e-4ad1-8faa-158a7cb3f036 tempest-TestImageHashVerification-1890905590 None] Copy volume to image completed successfully. Sep 25 13:49:40 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 1073741824" returned: 0 in 0.589s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:40 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 Sep 25 13:49:40 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:40 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-22dc7592-1a65-47c6-a40f-b82697b77e72 req-b4d334b6-8004-4a47-8dcc-de37e5071e97 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.695s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8615b16-da8d-46f2-951d-348d24d78c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543e4b7c-f611-45f6-a3bd-86126d6441b3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf06d0-8caa-4a95-82b1-0f3135eebd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-22dc7592-1a65-47c6-a40f-b82697b77e72 req-b4d334b6-8004-4a47-8dcc-de37e5071e97 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Volume volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 (543e4b7c-f611-45f6-a3bd-86126d6441b3): created successfully Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf06d0-8caa-4a95-82b1-0f3135eebd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (8a59ebfb-a586-429f-bb4b-83bf8f36d915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:49:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-03c03689-6f84-4fe3-93a6-63effefc7516 tempest-GroupSnapshotsTest-95560471 None] Created volume successfully. Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-22dc7592-1a65-47c6-a40f-b82697b77e72 req-b4d334b6-8004-4a47-8dcc-de37e5071e97 tempest-TestInstancesWithCinderVolumes-1755023412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-a90cfc83-5c87-42cb-936d-3291e9bde540', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9616047e-4707-4be4-b07d-f6c7bfd3bbc7', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:49:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-22dc7592-1a65-47c6-a40f-b82697b77e72 req-b4d334b6-8004-4a47-8dcc-de37e5071e97 tempest-TestInstancesWithCinderVolumes-1755023412 None] attachment_update completed successfully. Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Acquiring lock "cinder-c54a0447-bd2f-463d-b622-c7d6048230bf-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Lock "cinder-c54a0447-bd2f-463d-b622-c7d6048230bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Acquiring lock "cinder-quobyte-c54a0447-bd2f-463d-b622-c7d6048230bf" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Lock "cinder-quobyte-c54a0447-bd2f-463d-b622-c7d6048230bf" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48e445-376b-4fe7-bbe8-b4eee11bb52d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:41 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf Sep 25 13:49:41 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:41 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf" returned: 0 in 0.553s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:41 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf Sep 25 13:49:41 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (50d6f550-a8a6-4821-a36b-2abc1d612b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5129a6-340d-4f4e-8e86-c03240625f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5129a6-340d-4f4e-8e86-c03240625f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256973967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eeb9c40-06be-4c8a-b8a3-4b46026d7e17,host='devstack@QuobyteHD#QuobyteHD',id=e0df634e-d3ac-4063-b297-70dad8e86451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:49:42Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d804d5-8434-4b7c-a6c2-da5b5b6ffc89),volume_type_id=85d804d5-8434-4b7c-a6c2-da5b5b6ffc89)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b880b6a0-a205-41e7-a99e-65e0e4b33811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b880b6a0-a205-41e7-a99e-65e0e4b33811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0aa19a-dbb3-4013-b39a-89cdf42fb769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0aa19a-dbb3-4013-b39a-89cdf42fb769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0df634e-d3ac-4063-b297-70dad8e86451', 'volume_name': 'volume-e0df634e-d3ac-4063-b297-70dad8e86451', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b459d34e-84b0-4522-875c-6ed39ff2623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b459d34e-84b0-4522-875c-6ed39ff2623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc37916e-17b9-4075-ba54-6c29d7cf3c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Volume e0df634e-d3ac-4063-b297-70dad8e86451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0df634e-d3ac-4063-b297-70dad8e86451', 'volume_size': 1} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1eeb9c40-06be-4c8a-b8a3-4b46026d7e17,created_at=2026-09-25T11:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256973967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eeb9c40-06be-4c8a-b8a3-4b46026d7e17,host='devstack@QuobyteHD#QuobyteHD',id=e0df634e-d3ac-4063-b297-70dad8e86451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:49:42Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d804d5-8434-4b7c-a6c2-da5b5b6ffc89),volume_type_id=85d804d5-8434-4b7c-a6c2-da5b5b6ffc89)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Creating volume e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:49:41 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:41 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c54a0447-bd2f-463d-b622-c7d6048230bf" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:41 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 1073741824 Sep 25 13:49:41 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Lock "cinder-quobyte-c54a0447-bd2f-463d-b622-c7d6048230bf" released by "delete_volume" :: held 0.995s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Created reservations ['b368b19a-1659-414b-9269-1849e826ee71', 'd1ab05e9-37b8-4dd0-83af-d5265d2fe112', '1cd17f55-1505-4cc1-8b28-d2945de96c16', 'bf502224-7c60-45d3-8011-7416fb6f5f5e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:42 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:49:42 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:42 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.282s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:49:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Deleted volume successfully. Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-da6ac632-881b-45fa-904a-753ab6cb51f6 tempest-TestImageHashVerification-1890905590 None] Lock "cinder-c54a0447-bd2f-463d-b622-c7d6048230bf-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:42 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 1073741824" returned: 0 in 0.606s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:42 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 Sep 25 13:49:42 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:42 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451" returned: 0 in 0.339s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc37916e-17b9-4075-ba54-6c29d7cf3c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0df634e-d3ac-4063-b297-70dad8e86451', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff0bda1-a31a-4e6b-8ca0-43377a6f1ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:49:42 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Volume volume-e0df634e-d3ac-4063-b297-70dad8e86451 (e0df634e-d3ac-4063-b297-70dad8e86451): created successfully Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff0bda1-a31a-4e6b-8ca0-43377a6f1ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:49:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (50d6f550-a8a6-4821-a36b-2abc1d612b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:49:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-03dd1433-193a-4ca3-9b49-6d4644c56f1e tempest-GroupSnapshotsTest-95560471 None] Created volume successfully. Sep 25 13:49:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-973eeeb8-f2ab-46f2-b6ad-840af4d2e486 req-62bacd21-e798-4c4f-8dec-8a792b313fa6 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-973eeeb8-f2ab-46f2-b6ad-840af4d2e486 req-62bacd21-e798-4c4f-8dec-8a792b313fa6 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-973eeeb8-f2ab-46f2-b6ad-840af4d2e486 req-62bacd21-e798-4c4f-8dec-8a792b313fa6 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-973eeeb8-f2ab-46f2-b6ad-840af4d2e486 req-62bacd21-e798-4c4f-8dec-8a792b313fa6 tempest-TestInstancesWithCinderVolumes-1755023412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09cd2e41-8d7a-4049-9df0-014615602d5f', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:49:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-973eeeb8-f2ab-46f2-b6ad-840af4d2e486 req-62bacd21-e798-4c4f-8dec-8a792b313fa6 tempest-TestInstancesWithCinderVolumes-1755023412 None] attachment_update completed successfully. Sep 25 13:49:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d8337c8f-07b3-4451-9349-fa4fe817fb12 tempest-GroupSnapshotsTest-95560471 None] Update group completed successfully. Sep 25 13:49:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-dac49547-1ca9-4287-8049-a8dc2acb632e tempest-GroupSnapshotsTest-95560471 None] Update group completed successfully. Sep 25 13:49:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3e130abc-0e75-4bef-9a18-ac9f1d0bcdb6 tempest-GroupSnapshotsTest-95560471 None] Update group completed successfully. Sep 25 13:49:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d690972a-2c56-455f-add2-cd9043218139 tempest-GroupSnapshotsTest-95560471 None] Update group completed successfully. Sep 25 13:49:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] GroupSnapshot cd8885b2-20ac-4b26-a3aa-e66e4809fc88: creating. Sep 25 13:49:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Group snapshot cd8885b2-20ac-4b26-a3aa-e66e4809fc88: creating. {{(pid=87220) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Creating offline snapshot 4fb085cf-e7ba-4f5c-9338-676526bb7020 of volume e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a7d2b-1775-4a40-baad-490c4a114169]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:50 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 Sep 25 13:49:50 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:50 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451" returned: 0 in 0.534s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:50 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 1G Sep 25 13:49:50 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-7eb336bf-9e29-4814-857b-b27872de06e3 req-0fe54104-1ec7-4b53-a406-0e5a17c1707c tempest-TestInstancesWithCinderVolumes-1755023412 None] Terminate volume connection completed successfully. Sep 25 13:49:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-7eb336bf-9e29-4814-857b-b27872de06e3 req-0fe54104-1ec7-4b53-a406-0e5a17c1707c tempest-TestInstancesWithCinderVolumes-1755023412 None] Deleting attachment 9616047e-4707-4be4-b07d-f6c7bfd3bbc7. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:49:51 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 1G" returned: 0 in 0.668s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0df634e-d3ac-4063-b297-70dad8e86451 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:51 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0df634e-d3ac-4063-b297-70dad8e86451 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 Sep 25 13:49:51 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "cinder-a90cfc83-5c87-42cb-936d-3291e9bde540-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-a90cfc83-5c87-42cb-936d-3291e9bde540-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "cinder-quobyte-a90cfc83-5c87-42cb-936d-3291e9bde540" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-quobyte-a90cfc83-5c87-42cb-936d-3291e9bde540" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec09d9e-4a85-4c63-8166-60aeb44992bc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:51 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 Sep 25 13:49:51 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:51 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0df634e-d3ac-4063-b297-70dad8e86451 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020" returned: 0 in 0.458s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:51 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:49:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:51 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 Sep 25 13:49:51 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:52 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020" returned: 0 in 0.404s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:52 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540" returned: 0 in 0.623s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:52 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info Sep 25 13:49:52 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:52 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540 Sep 25 13:49:52 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:52 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a90cfc83-5c87-42cb-936d-3291e9bde540" returned: 0 in 0.347s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-quobyte-a90cfc83-5c87-42cb-936d-3291e9bde540" released by "delete_volume" :: held 1.053s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:52 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:52 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:52 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info Sep 25 13:49:52 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:52 devstack cinder-volume[87220]: WARNING cinder.quota [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896715051-1338681072 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896715051-1338681072, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:52 devstack cinder-volume[87220]: WARNING cinder.quota [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896715051-1338681072 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896715051-1338681072, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Created reservations ['e0dc036a-25aa-4f87-b411-71f0e70f4f64', '21d0aead-314c-423f-9e97-53779f4151e2', 'e08fbc4b-910c-429f-a00f-bb56b5b58f2d', 'fbd84a8d-29f2-4366-abd4-8395236ea933'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:52 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:49:52 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:53 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.info" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Creating offline snapshot 592e53a3-6016-42b2-b27e-424eef039904 of volume 543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2684c458-be3a-4556-aefe-f5a216e5e348]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:53 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.370s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:49:53 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Deleted volume successfully. Sep 25 13:49:53 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 Sep 25 13:49:53 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-44fc3b48-8746-41f3-a95d-98ae95d5cff1 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-a90cfc83-5c87-42cb-936d-3291e9bde540-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:53 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3" returned: 0 in 0.463s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:53 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 1G Sep 25 13:49:53 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:54 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 1G" returned: 0 in 0.638s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:54 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 Sep 25 13:49:54 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:54 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:54 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:49:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:54 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 Sep 25 13:49:54 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:54 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904" returned: 0 in 0.304s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:55 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info Sep 25 13:49:55 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:55 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info" returned: 0 in 0.405s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:55 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:49:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:55 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info Sep 25 13:49:55 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:55 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.info" returned: 0 in 0.332s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9a2fe485-e3b5-413b-9850-2946267e7b4d tempest-GroupSnapshotsTest-95560471 None] group_snapshot cd8885b2-20ac-4b26-a3aa-e66e4809fc88: created successfully Sep 25 13:49:56 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] group_snapshot cd8885b2-20ac-4b26-a3aa-e66e4809fc88: deleting Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] group_snapshot cd8885b2-20ac-4b26-a3aa-e66e4809fc88: deleting {{(pid=87220) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-e0df634e-d3ac-4063-b297-70dad8e86451" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-e0df634e-d3ac-4063-b297-70dad8e86451" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-4fb085cf-e7ba-4f5c-9338-676526bb7020" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:56 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-969d29d7-1cec-4036-a78e-bc862d5466e2 req-1656e2ce-10c5-4f95-b3fe-99110477886f tempest-TestInstancesWithCinderVolumes-1755023412 None] Terminate volume connection completed successfully. Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-969d29d7-1cec-4036-a78e-bc862d5466e2 req-1656e2ce-10c5-4f95-b3fe-99110477886f tempest-TestInstancesWithCinderVolumes-1755023412 None] Deleting attachment 09cd2e41-8d7a-4049-9df0-014615602d5f. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-4fb085cf-e7ba-4f5c-9338-676526bb7020" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Deleting offline snapshot 4fb085cf-e7ba-4f5c-9338-676526bb7020 of volume e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] snapshot_file for this snap is: volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d469311-9d7d-478a-a9e5-33f6798bfbc7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:57 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 Sep 25 13:49:57 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "cinder-267129d0-4b1f-4c50-ab26-7e57c3e574e8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-267129d0-4b1f-4c50-ab26-7e57c3e574e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "cinder-quobyte-267129d0-4b1f-4c50-ab26-7e57c3e574e8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-quobyte-267129d0-4b1f-4c50-ab26-7e57c3e574e8" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff9b0a-b03d-47ac-956a-12313fde753c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:57 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020" returned: 0 in 0.631s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0df634e-d3ac-4063-b297-70dad8e86451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2882c49-43bc-4c6e-bfe2-b4ceddd5188b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:57 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 Sep 25 13:49:57 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:57 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 Sep 25 13:49:57 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:58 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8" returned: 0 in 0.636s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:58 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451" returned: 0 in 0.561s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:58 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8 Sep 25 13:49:58 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:58 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 Sep 25 13:49:58 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:58 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-267129d0-4b1f-4c50-ab26-7e57c3e574e8" returned: 0 in 0.336s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-quobyte-267129d0-4b1f-4c50-ab26-7e57c3e574e8" released by "delete_volume" :: held 1.042s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:58 devstack cinder-volume[87220]: WARNING cinder.quota [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-94994977-1499862568 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-94994977-1499862568, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:58 devstack cinder-volume[87220]: WARNING cinder.quota [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-94994977-1499862568 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-94994977-1499862568, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Created reservations ['97d9731f-6e06-4252-8f5c-7729f3f6e35b', 'b6f7ca7b-484c-41b1-ae50-4cd78625854e', '0840684d-0c7a-48ab-936d-3ad5e2cd3ad6', '0db9b132-f7d5-48e7-9b37-eac76d78f150'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:49:58 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020" returned: 0 in 0.555s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:49:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:58 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020 Sep 25 13:49:58 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:58 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:49:58 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:59 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451.4fb085cf-e7ba-4f5c-9338-676526bb7020" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:59 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-4fb085cf-e7ba-4f5c-9338-676526bb7020" released by "_delete_snapshot" :: held 2.343s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Deleted volume successfully. Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-e0df634e-d3ac-4063-b297-70dad8e86451" released by "delete_snapshot" :: held 2.388s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-543e4b7c-f611-45f6-a3bd-86126d6441b3" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8b96bf63-5901-4f10-bce9-6f3a4a35f24d tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-267129d0-4b1f-4c50-ab26-7e57c3e574e8-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-543e4b7c-f611-45f6-a3bd-86126d6441b3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-592e53a3-6016-42b2-b27e-424eef039904" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-592e53a3-6016-42b2-b27e-424eef039904" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Deleting offline snapshot 592e53a3-6016-42b2-b27e-424eef039904 of volume 543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] snapshot_file for this snap is: volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c47b8-90c6-4905-8ad1-d3c8c22cc537]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:49:59 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 Sep 25 13:49:59 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:49:59 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904" returned: 0 in 0.671s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:49:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-543e4b7c-f611-45f6-a3bd-86126d6441b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:50:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb393c8-8f63-474f-b2a5-61653bb62db9]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:00 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 Sep 25 13:50:00 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:00 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3" returned: 0 in 0.560s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:00 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 Sep 25 13:50:00 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:01 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904" returned: 0 in 0.579s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:01 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904 Sep 25 13:50:01 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:01 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3.592e53a3-6016-42b2-b27e-424eef039904" returned: 0 in 0.353s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-592e53a3-6016-42b2-b27e-424eef039904" released by "_delete_snapshot" :: held 2.373s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-543e4b7c-f611-45f6-a3bd-86126d6441b3" released by "delete_snapshot" :: held 2.405s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:01 devstack cinder-volume[87220]: WARNING cinder.quota [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1144862584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1144862584, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:01 devstack cinder-volume[87220]: WARNING cinder.quota [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1144862584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1144862584, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['206d4a4a-8c58-4154-af35-efaea0cbf134', '1c85f42a-d76c-4d29-8833-edcfa10a3839', 'a4e2ed5b-68ba-42dd-8ac3-95f1b24a770a', '6207d3a9-2f05-4dc9-91b7-de0e7044328b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:01 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['b7a39877-1da0-4f33-a617-f04d02c118e2', 'f3411910-0c79-4063-a976-c44bd269655c', 'c201ee9e-fae1-4a3d-b3fc-d11934961b90', '1a9fb7cf-7a28-4cd4-9097-04bfd5a7bbec'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4ae85a48-a036-4cd3-91ed-43ca7b901570 tempest-GroupSnapshotsTest-95560471 None] group_snapshot cd8885b2-20ac-4b26-a3aa-e66e4809fc88: deleted successfully Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-543e4b7c-f611-45f6-a3bd-86126d6441b3" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-543e4b7c-f611-45f6-a3bd-86126d6441b3" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccd54ff-a99f-44d4-bf31-f7678198fbdf]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-18bc7ce2-4615-48cb-af9b-8861358d222e req-9ff3aa0c-e5cf-4c81-9862-5c9df69582dd tempest-TestInstancesWithCinderVolumes-1755023412 None] Terminate volume connection completed successfully. Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-18bc7ce2-4615-48cb-af9b-8861358d222e req-9ff3aa0c-e5cf-4c81-9862-5c9df69582dd tempest-TestInstancesWithCinderVolumes-1755023412 None] Deleting attachment c8fcc3ae-3075-4c62-bb64-180274ce83e7. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:50:03 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 Sep 25 13:50:03 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:03 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3" returned: 0 in 0.498s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:03 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3 Sep 25 13:50:03 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:04 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-543e4b7c-f611-45f6-a3bd-86126d6441b3" returned: 0 in 0.310s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-543e4b7c-f611-45f6-a3bd-86126d6441b3" released by "delete_volume" :: held 0.950s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-e0df634e-d3ac-4063-b297-70dad8e86451" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-e0df634e-d3ac-4063-b297-70dad8e86451" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba1e80b-1370-4227-87d1-9e115178d7f5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:04 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 Sep 25 13:50:04 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Flow 'volume_create_manager' (05e73356-f68a-43ef-8965-086adbdbd898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432d2d59-33f8-48b5-b018-6630bcc45a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:04 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432d2d59-33f8-48b5-b018-6630bcc45a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac463587-f5df-4ef5-93d3-97674ba62787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f480afbca14b60bf8572701838ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:05Z,use_quota=True,user_id='756a3ff5539a429db36f616fe59033ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a78600f-b68e-430b-817f-001d934a1295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a78600f-b68e-430b-817f-001d934a1295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9fbaf0-ebba-4c5c-b26c-32929838e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451" returned: 0 in 0.589s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:04 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451 Sep 25 13:50:04 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9fbaf0-ebba-4c5c-b26c-32929838e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac463587-f5df-4ef5-93d3-97674ba62787', 'volume_name': 'volume-ac463587-f5df-4ef5-93d3-97674ba62787', 'volume_size': 1, 'image_id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ffb5bd9c59045a448d0de27f10261663', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26f480afbca14b60bf8572701838ecaf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '684ca51bc463ef9a7a527e6de98da61874c96be4f68c8fd6a3ef8a87563a1dfdc927df567fe7063615cf9035ecdd1d76e8a97954072763daa61b1522c5157cb1', 'id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'created_at': datetime.datetime(2026, 9, 25, 11, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 50, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b/file', 'properties': {}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf7d85c-90d3-4b0a-a78f-b9d9fdf4f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf7d85c-90d3-4b0a-a78f-b9d9fdf4f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0fda6e-ce9f-40d9-9d92-6357c7b19f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Volume ac463587-f5df-4ef5-93d3-97674ba62787: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac463587-f5df-4ef5-93d3-97674ba62787', 'volume_size': 1, 'image_id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ffb5bd9c59045a448d0de27f10261663', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26f480afbca14b60bf8572701838ecaf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '684ca51bc463ef9a7a527e6de98da61874c96be4f68c8fd6a3ef8a87563a1dfdc927df567fe7063615cf9035ecdd1d76e8a97954072763daa61b1522c5157cb1', 'id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'created_at': datetime.datetime(2026, 9, 25, 11, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 50, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b/file', 'properties': {}}, 'image_service': } Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Trying to clone ac463587-f5df-4ef5-93d3-97674ba62787 from image 29a1d69d-e579-4f25-b1bd-2a50f61faf8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:50:05 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e0df634e-d3ac-4063-b297-70dad8e86451" returned: 0 in 0.316s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-e0df634e-d3ac-4063-b297-70dad8e86451" released by "delete_volume" :: held 0.999s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:50:05 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797ab45-49eb-4d9b-98ae-c591c665de18]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Created reservations ['91314023-936b-4a54-9ca9-41a048a42f6d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:05 devstack cinder-volume[87220]: WARNING cinder.quota [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1144862584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1144862584, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Created reservations ['06ce8325-fb5f-45cd-83f8-cf42dd01d16e', 'f8c13ebb-5c9b-4be0-ba11-727a3e2332d4', '4481981e-c763-4d03-bd41-f67a1b693f8e', '30991916-6149-401c-a0b5-1be72534076c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:05 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD Sep 25 13:50:05 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Created reservations ['b6c1eaf5-ca5a-42df-bfb7-4fa38fe4ae1e', 'ea17fe57-1c87-474c-8c4c-073f804227b3', '801c7b9b-c41a-4e91-bfff-de9548d7736f', '40e7759d-4ed8-442a-9411-e8c70669f573'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:05 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:05 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:05 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "cinder-68c07990-a614-40d7-adba-9d39763359a8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-68c07990-a614-40d7-adba-9d39763359a8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "cinder-quobyte-68c07990-a614-40d7-adba-9d39763359a8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-quobyte-68c07990-a614-40d7-adba-9d39763359a8" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a488c4-d265-48aa-9c17-5a3707d270fc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:05 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD Sep 25 13:50:05 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:06 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.375s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c199e112-54c3-488b-9402-f6531e5b536b tempest-GroupSnapshotsTest-95560471 None] Delete group completed successfully. Sep 25 13:50:06 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 Sep 25 13:50:06 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:06 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD" returned: 1 in 0.526s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Temporary image 29a1d69d-e579-4f25-b1bd-2a50f61faf8b is fetched for user 756a3ff5539a429db36f616fe59033ba. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e313652-a03c-49e1-9bf0-5661f6307f4d]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-01f9b77a-221e-46b6-8705-975b27de018c tempest-GroupSnapshotsTest-95560471 None] Group tempest-GroupSnapshotsTest-Group-416394287: creating Sep 25 13:50:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-01f9b77a-221e-46b6-8705-975b27de018c tempest-GroupSnapshotsTest-95560471 None] Group tempest-GroupSnapshotsTest-Group-416394287: created successfully Sep 25 13:50:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-01f9b77a-221e-46b6-8705-975b27de018c tempest-GroupSnapshotsTest-95560471 None] Create group completed successfully. Sep 25 13:50:06 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8" returned: 0 in 0.550s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:06 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD Sep 25 13:50:06 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:06 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8 Sep 25 13:50:06 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:06 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68c07990-a614-40d7-adba-9d39763359a8" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-quobyte-68c07990-a614-40d7-adba-9d39763359a8" released by "delete_volume" :: held 0.894s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:06 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:06 devstack cinder-volume[87220]: WARNING cinder.quota [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752676603-577614037 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752676603-577614037, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:06 devstack cinder-volume[87220]: WARNING cinder.quota [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752676603-577614037 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-752676603-577614037, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Created reservations ['1c177616-bb90-4acc-8ab7-dbb0e6cb0621', '64143be9-96c1-4b74-9807-e6d4f6dd3bcd', 'ddd153bf-2e4b-4633-845e-71e7ffa4d60b', 'f4c10f38-213e-4aa8-a4dc-e5990f9c6cad'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:07 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD Sep 25 13:50:07 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:07 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:07 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:07 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac463587-f5df-4ef5-93d3-97674ba62787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f480afbca14b60bf8572701838ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:05Z,use_quota=True,user_id='756a3ff5539a429db36f616fe59033ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Creating volume ac463587-f5df-4ef5-93d3-97674ba62787 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:07 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:07 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 1073741824 Sep 25 13:50:07 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:07 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.343s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Deleted volume successfully. Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cf385206-6160-431f-9a53-074ccfe390d8 tempest-TestInstancesWithCinderVolumes-1755023412 None] Lock "cinder-68c07990-a614-40d7-adba-9d39763359a8-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:07 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 1073741824" returned: 0 in 0.599s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:07 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 Sep 25 13:50:07 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (cf3c35e3-d6cc-451c-99c2-32e98acbe9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1e3900-95f1-4228-83e3-712801e59e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1e3900-95f1-4228-83e3-712801e59e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-430903053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0cef353-7ecd-4b95-866f-4950def105fd,host='devstack@QuobyteHD#QuobyteHD',id=f0d38aca-99e3-40c8-9ce9-c740aad902c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:08Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87dc8571-1c7c-483b-8d9a-254f0a805921),volume_type_id=87dc8571-1c7c-483b-8d9a-254f0a805921)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6143e3-6523-4eae-a1fc-92e59f6db0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6143e3-6523-4eae-a1fc-92e59f6db0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:08 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d6bb6-7b36-4973-9551-2bfc3eb2daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d6bb6-7b36-4973-9551-2bfc3eb2daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d38aca-99e3-40c8-9ce9-c740aad902c9', 'volume_name': 'volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919ea8e9-a791-42a9-8de8-02d9c3e93671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919ea8e9-a791-42a9-8de8-02d9c3e93671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30900bb2-2fc0-4a0b-86c9-0d354f0ee654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Volume f0d38aca-99e3-40c8-9ce9-c740aad902c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9', 'volume_size': 1} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787" returned: 0 in 0.449s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0cef353-7ecd-4b95-866f-4950def105fd,created_at=2026-09-25T11:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-430903053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0cef353-7ecd-4b95-866f-4950def105fd,host='devstack@QuobyteHD#QuobyteHD',id=f0d38aca-99e3-40c8-9ce9-c740aad902c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe528aa7f604790bb8a62776cd4756e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:08Z,use_quota=True,user_id='f937340dcc2e46f0a9d0cb35245602ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87dc8571-1c7c-483b-8d9a-254f0a805921),volume_type_id=87dc8571-1c7c-483b-8d9a-254f0a805921)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Creating volume f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:08 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:08 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 1073741824 Sep 25 13:50:08 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Attempting download of 29a1d69d-e579-4f25-b1bd-2a50f61faf8b ((None, [{'url': 'file:///opt/stack/data/glance/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'metadata': {}}])) to volume ac463587-f5df-4ef5-93d3-97674ba62787. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52e408-aa97-4040-a974-d63f681ffd8c]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:08 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4 Sep 25 13:50:08 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:08 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4" returned: 0 in 0.427s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:08 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 1073741824" returned: 0 in 0.611s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:09 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4 Sep 25 13:50:09 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:09 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 Sep 25 13:50:09 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:09 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4" returned: 1 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_coacfll4' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5282529-76d5-41b9-8bf1-3ea2918ed0e3]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:09 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9" returned: 0 in 0.293s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30900bb2-2fc0-4a0b-86c9-0d354f0ee654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa83729-2b3b-4cf8-bc37-686857b181f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:09 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Volume volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 (f0d38aca-99e3-40c8-9ce9-c740aad902c9): created successfully Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa83729-2b3b-4cf8-bc37-686857b181f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Flow 'volume_create_manager' (cf3c35e3-d6cc-451c-99c2-32e98acbe9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5b40ba1e-5ddf-4b0e-bbf7-1451b559ff48 tempest-GroupSnapshotsTest-95560471 None] Created volume successfully. Sep 25 13:50:09 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD Sep 25 13:50:09 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:09 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:09 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD Sep 25 13:50:09 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] GroupSnapshot e0a3f019-401c-4fb2-925a-78b796e77efa: creating. Sep 25 13:50:10 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:10 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Group snapshot e0a3f019-401c-4fb2-925a-78b796e77efa: creating. {{(pid=87220) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Creating offline snapshot 927bd4b7-9390-4da8-8b97-67c4172476be of volume f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb3405-ef87-4e04-9081-51487f594d45]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:10 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 Sep 25 13:50:10 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:10 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD" returned: 1 in 0.546s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] 29a1d69d-e579-4f25-b1bd-2a50f61faf8b was raw, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:10 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:10 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:50:10 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:50:10 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9" returned: 0 in 0.472s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:10 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be 1G Sep 25 13:50:10 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:10 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787" returned: 0 in 0.564s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29a1d69d-e579-4f25-b1bd-2a50f61faf8b_ujnkb8aedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:50:10 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:50:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:10 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 1G Sep 25 13:50:10 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:11 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be 1G" returned: 0 in 0.592s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:11 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be Sep 25 13:50:11 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:11 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 1G" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Downloaded image 29a1d69d-e579-4f25-b1bd-2a50f61faf8b ((None, [{'url': 'file:///opt/stack/data/glance/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'metadata': {}}])) to volume ac463587-f5df-4ef5-93d3-97674ba62787 successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Temporary image 29a1d69d-e579-4f25-b1bd-2a50f61faf8b for user 756a3ff5539a429db36f616fe59033ba is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Marking volume ac463587-f5df-4ef5-93d3-97674ba62787 as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Copying metadata from image 29a1d69d-e579-4f25-b1bd-2a50f61faf8b to ac463587-f5df-4ef5-93d3-97674ba62787. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Creating volume glance metadata for volume ac463587-f5df-4ef5-93d3-97674ba62787 backed by image 29a1d69d-e579-4f25-b1bd-2a50f61faf8b with: {'image_id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ffb5bd9c59045a448d0de27f10261663', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0fda6e-ce9f-40d9-9d92-6357c7b19f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac463587-f5df-4ef5-93d3-97674ba62787', 'volume_size': 1, 'image_id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ffb5bd9c59045a448d0de27f10261663', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26f480afbca14b60bf8572701838ecaf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '684ca51bc463ef9a7a527e6de98da61874c96be4f68c8fd6a3ef8a87563a1dfdc927df567fe7063615cf9035ecdd1d76e8a97954072763daa61b1522c5157cb1', 'id': '29a1d69d-e579-4f25-b1bd-2a50f61faf8b', 'created_at': datetime.datetime(2026, 9, 25, 11, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 50, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29a1d69d-e579-4f25-b1bd-2a50f61faf8b/file', 'properties': {}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a329bf-7919-4dbc-85d2-3261d30a5277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Volume volume-ac463587-f5df-4ef5-93d3-97674ba62787 (ac463587-f5df-4ef5-93d3-97674ba62787): created successfully Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a329bf-7919-4dbc-85d2-3261d30a5277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Flow 'volume_create_manager' (05e73356-f68a-43ef-8965-086adbdbd898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:11 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-253d6bc5-9da9-46a5-a7b2-2ff13fe89abf tempest-VolumeImageDependencyTests-1379360878 None] Created volume successfully. Sep 25 13:50:11 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be" returned: 0 in 0.404s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:11 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:11 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be Sep 25 13:50:11 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:11 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:11 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info Sep 25 13:50:11 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:12 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info" returned: 0 in 0.280s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:12 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:12 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info Sep 25 13:50:12 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Acquiring lock "cinder-ac463587-f5df-4ef5-93d3-97674ba62787-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Lock "cinder-ac463587-f5df-4ef5-93d3-97674ba62787-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Acquiring lock "cinder-quobyte-ac463587-f5df-4ef5-93d3-97674ba62787" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:12 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.info" returned: 0 in 0.383s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Lock "cinder-quobyte-ac463587-f5df-4ef5-93d3-97674ba62787" acquired by "delete_volume" :: waited 0.094s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[714d65c8-59b8-4293-b30f-42bbf21556c9]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-257a8413-9156-4ffe-a242-2c4f43c62aad tempest-GroupSnapshotsTest-95560471 None] group_snapshot e0a3f019-401c-4fb2-925a-78b796e77efa: created successfully Sep 25 13:50:12 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 Sep 25 13:50:12 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:13 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787" returned: 0 in 0.536s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:13 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787 Sep 25 13:50:13 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] group_snapshot e0a3f019-401c-4fb2-925a-78b796e77efa: deleting Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] group_snapshot e0a3f019-401c-4fb2-925a-78b796e77efa: deleting {{(pid=87220) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-f0d38aca-99e3-40c8-9ce9-c740aad902c9" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-f0d38aca-99e3-40c8-9ce9-c740aad902c9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-927bd4b7-9390-4da8-8b97-67c4172476be" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:13 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ac463587-f5df-4ef5-93d3-97674ba62787" returned: 0 in 0.338s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Lock "cinder-quobyte-ac463587-f5df-4ef5-93d3-97674ba62787" released by "delete_volume" :: held 0.937s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-927bd4b7-9390-4da8-8b97-67c4172476be" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Deleting offline snapshot 927bd4b7-9390-4da8-8b97-67c4172476be of volume f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] snapshot_file for this snap is: volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ef513-c45c-424e-9521-a24e261c5dfd]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Created reservations ['287c8380-33a0-4db5-b87b-db097f267ea2', 'b9f9dbf1-7737-4933-bfdb-f7db7960ccfe', 'c612eb3f-a0ad-4eda-a439-d42ec62f3276', '111f46cf-ca0c-4f30-afc2-57127434fb9e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:13 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be Sep 25 13:50:13 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:13 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:13 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:14 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.311s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Deleted volume successfully. Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-628d6c02-5d2a-4113-87a1-a77164cb1345 tempest-VolumeImageDependencyTests-1379360878 None] Lock "cinder-ac463587-f5df-4ef5-93d3-97674ba62787-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:14 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be" returned: 0 in 0.629s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b3697b-1ba5-4877-bb95-9e48eb64ca37]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:14 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 Sep 25 13:50:14 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:14 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9" returned: 0 in 0.397s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:14 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be Sep 25 13:50:14 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:15 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be" returned: 0 in 0.547s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:15 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be Sep 25 13:50:15 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:15 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9.927bd4b7-9390-4da8-8b97-67c4172476be" returned: 0 in 0.325s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-927bd4b7-9390-4da8-8b97-67c4172476be" released by "_delete_snapshot" :: held 2.055s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-f0d38aca-99e3-40c8-9ce9-c740aad902c9" released by "delete_snapshot" :: held 2.106s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:15 devstack cinder-volume[87220]: WARNING cinder.quota [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1359197159 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1359197159, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:15 devstack cinder-volume[87220]: WARNING cinder.quota [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1359197159 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1359197159, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:15 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] Created reservations ['9eea8a5b-cd06-4d26-829e-741a09508c73', 'e6a6ca2e-cae9-490b-b5de-40d2996fd89e', 'd1ee7f7f-3f47-4ba9-8531-676bd87fbd11', 'e76cca03-cc6f-4a5d-ad4f-035e10788c01'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6d29e638-2906-45ac-ba33-41dc682647ba tempest-GroupSnapshotsTest-95560471 None] group_snapshot e0a3f019-401c-4fb2-925a-78b796e77efa: deleted successfully Sep 25 13:50:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "cinder-quobyte-f0d38aca-99e3-40c8-9ce9-c740aad902c9" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-f0d38aca-99e3-40c8-9ce9-c740aad902c9" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d6afe-8b0e-4764-916e-675773ff7f5a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:16 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 Sep 25 13:50:16 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:16 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9" returned: 0 in 0.467s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:17 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9 Sep 25 13:50:17 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:17 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f0d38aca-99e3-40c8-9ce9-c740aad902c9" returned: 0 in 0.370s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Lock "cinder-quobyte-f0d38aca-99e3-40c8-9ce9-c740aad902c9" released by "delete_volume" :: held 0.955s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['6d9ac4c6-332b-4907-a5df-9ca10eb1f513'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:17 devstack cinder-volume[87220]: WARNING cinder.quota [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1359197159 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1359197159, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Created reservations ['4308fff3-e9f1-41db-bcc5-b596e9d4b64f', 'b9ccf3ec-90f9-4f3b-ade8-e20bba610153', '8fc1292f-c9a8-4803-83ad-a20c5ed8b127', '31d6d722-9f71-4334-8543-15ed41c43fcd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:17 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:17 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:17 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.271s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:17 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2bd909cc-d043-47fb-bd63-5245b4685ba0 tempest-GroupSnapshotsTest-95560471 None] Delete group completed successfully. Sep 25 13:50:24 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (e025a50d-2118-4be0-b3f4-01ef7b7e96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3ef703-2494-4f51-a768-7e92dc3568cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3ef703-2494-4f51-a768-7e92dc3568cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-964569262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87684b04-ffd9-4a09-918c-dea60e1f6ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:25Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27aa6f4-45d0-4d9e-969f-03aa1b2699c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27aa6f4-45d0-4d9e-969f-03aa1b2699c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4d975f-7976-464e-8527-18c83130db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4d975f-7976-464e-8527-18c83130db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87684b04-ffd9-4a09-918c-dea60e1f6ca7', 'volume_name': 'volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689de183-3f3e-44c8-a00d-735954efaacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689de183-3f3e-44c8-a00d-735954efaacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed9679e-f9a1-487a-812e-c5cb60f0e8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:25 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume 87684b04-ffd9-4a09-918c-dea60e1f6ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7', 'volume_size': 1} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-964569262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87684b04-ffd9-4a09-918c-dea60e1f6ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:25Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Creating volume 87684b04-ffd9-4a09-918c-dea60e1f6ca7 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:25 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:25 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 1073741824 Sep 25 13:50:25 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:25 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 1073741824" returned: 0 in 0.550s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:25 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 Sep 25 13:50:25 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:25 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7" returned: 0 in 0.302s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed9679e-f9a1-487a-812e-c5cb60f0e8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da80f4dd-1402-4568-9e17-a90a5ee3ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:26 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 (87684b04-ffd9-4a09-918c-dea60e1f6ca7): created successfully Sep 25 13:50:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da80f4dd-1402-4568-9e17-a90a5ee3ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (e025a50d-2118-4be0-b3f4-01ef7b7e96cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8a311e80-7758-4636-ab35-7df6fd6b6868 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created volume successfully. Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (b8eb90d2-4814-4f2c-9127-4f108656076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e038ee36-47db-4e63-b7d2-8641dbf8b3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e038ee36-47db-4e63-b7d2-8641dbf8b3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482428050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9b8742-5e4b-47b8-be5c-19d54c658d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:28Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0055e15a-31dd-4ae6-8203-50d41a9f929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0055e15a-31dd-4ae6-8203-50d41a9f929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d8f5b8-ca60-4d93-99ee-77d63d7a5187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d8f5b8-ca60-4d93-99ee-77d63d7a5187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9b8742-5e4b-47b8-be5c-19d54c658d91', 'volume_name': 'volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7093839-ae96-4295-9cb9-723c4f774742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7093839-ae96-4295-9cb9-723c4f774742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd23d61-6115-455a-ba2e-4e3a2a759bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:27 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume ea9b8742-5e4b-47b8-be5c-19d54c658d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91', 'volume_size': 1} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482428050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9b8742-5e4b-47b8-be5c-19d54c658d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:28Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Creating volume ea9b8742-5e4b-47b8-be5c-19d54c658d91 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:27 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:27 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 1073741824 Sep 25 13:50:27 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (43e3d7ed-fa42-4840-b13c-a68d46c01059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9cb823-c25a-4e8d-b55a-6ec8d0e42b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9cb823-c25a-4e8d-b55a-6ec8d0e42b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795721225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2375f651-aef1-40af-abd8-3b02a8b9abfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:28Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5eb605-2925-4134-b625-c9711165aafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5eb605-2925-4134-b625-c9711165aafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e2e224-cde6-4aa6-8f90-517e027d0ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e2e224-cde6-4aa6-8f90-517e027d0ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2375f651-aef1-40af-abd8-3b02a8b9abfc', 'volume_name': 'volume-2375f651-aef1-40af-abd8-3b02a8b9abfc', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4b32a4-bdfb-488e-9e2f-6892917a39ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4b32a4-bdfb-488e-9e2f-6892917a39ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e12f7e3-11aa-446a-a4dc-c1aab8ab2315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume 2375f651-aef1-40af-abd8-3b02a8b9abfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2375f651-aef1-40af-abd8-3b02a8b9abfc', 'volume_size': 1} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:28 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 1073741824" returned: 0 in 0.723s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:28 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 Sep 25 13:50:28 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (309e9ded-60aa-4622-8af3-10e4b1417595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ab4df1-13ed-4458-8b21-1c74292d477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ab4df1-13ed-4458-8b21-1c74292d477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825206861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2338536-e60e-4cf7-90f1-388b1437d224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:29Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4e97c5-0b34-4378-b4ee-a822dd92c274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4e97c5-0b34-4378-b4ee-a822dd92c274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492d4be9-5534-46d1-85dd-49c702dabb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492d4be9-5534-46d1-85dd-49c702dabb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2338536-e60e-4cf7-90f1-388b1437d224', 'volume_name': 'volume-c2338536-e60e-4cf7-90f1-388b1437d224', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367daba3-afec-4dda-8dd4-fcf0a5eec699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367daba3-afec-4dda-8dd4-fcf0a5eec699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e202f9-4af9-4cb4-9bc1-40b02dae24ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume c2338536-e60e-4cf7-90f1-388b1437d224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2338536-e60e-4cf7-90f1-388b1437d224', 'volume_size': 1} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:28 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91" returned: 0 in 0.437s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795721225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2375f651-aef1-40af-abd8-3b02a8b9abfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:28Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Creating volume 2375f651-aef1-40af-abd8-3b02a8b9abfc {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:28 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd23d61-6115-455a-ba2e-4e3a2a759bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e2e7a-88b5-4054-8642-cd39af7a1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc 1073741824 Sep 25 13:50:29 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 (ea9b8742-5e4b-47b8-be5c-19d54c658d91): created successfully Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e2e7a-88b5-4054-8642-cd39af7a1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (b8eb90d2-4814-4f2c-9127-4f108656076d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-676411a7-77ed-4df8-97e6-fd00b3230ec9 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created volume successfully. Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (e09a59dd-acb9-41e3-94dd-cd2e274ce4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2af166-6975-4e4b-8f48-cc73bc75b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2af166-6975-4e4b-8f48-cc73bc75b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280919155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dae2195-0060-4b9e-b04e-56b13227141e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:29Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e397660-1be0-487c-8620-7f730fa9a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e397660-1be0-487c-8620-7f730fa9a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db98cdf-71ed-4e97-829a-c950dad394c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db98cdf-71ed-4e97-829a-c950dad394c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dae2195-0060-4b9e-b04e-56b13227141e', 'volume_name': 'volume-5dae2195-0060-4b9e-b04e-56b13227141e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6419108-4aef-4082-8081-565572ac6f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6419108-4aef-4082-8081-565572ac6f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2a04b5-a198-40c5-981d-503324dfb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume 5dae2195-0060-4b9e-b04e-56b13227141e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dae2195-0060-4b9e-b04e-56b13227141e', 'volume_size': 1} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:29 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc 1073741824" returned: 0 in 0.786s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (59af5380-590c-4df8-969c-1f48feeb293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a37f1-49f8-458d-8b8d-8bbe7a524392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a37f1-49f8-458d-8b8d-8bbe7a524392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1910143267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e30953-571b-4363-83ce-b9c1ed0c5377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:30Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314bb29a-7a2d-4bf3-b933-57eed477e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314bb29a-7a2d-4bf3-b933-57eed477e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7db1959-dc7e-4f8a-8d00-e411faea8939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7db1959-dc7e-4f8a-8d00-e411faea8939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e30953-571b-4363-83ce-b9c1ed0c5377', 'volume_name': 'volume-80e30953-571b-4363-83ce-b9c1ed0c5377', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe6c94d-66fb-4715-a821-3459de4a77ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe6c94d-66fb-4715-a821-3459de4a77ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a99ca66-0c62-49ba-a7bc-6843e1b8388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume 80e30953-571b-4363-83ce-b9c1ed0c5377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e30953-571b-4363-83ce-b9c1ed0c5377', 'volume_size': 1} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:29 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc Sep 25 13:50:29 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:30 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc" returned: 0 in 0.276s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825206861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2338536-e60e-4cf7-90f1-388b1437d224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:29Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Creating volume c2338536-e60e-4cf7-90f1-388b1437d224 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:30 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e12f7e3-11aa-446a-a4dc-c1aab8ab2315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2375f651-aef1-40af-abd8-3b02a8b9abfc', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1d3b9e-8410-4ba0-be51-fc583ada6a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:30 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 1073741824 Sep 25 13:50:30 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:30 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume volume-2375f651-aef1-40af-abd8-3b02a8b9abfc (2375f651-aef1-40af-abd8-3b02a8b9abfc): created successfully Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1d3b9e-8410-4ba0-be51-fc583ada6a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (43e3d7ed-fa42-4840-b13c-a68d46c01059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bfa5b7f5-f41e-43e1-beb8-5339f377d019 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created volume successfully. Sep 25 13:50:30 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 1073741824" returned: 0 in 0.548s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:30 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 Sep 25 13:50:30 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:31 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224" returned: 0 in 0.307s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280919155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dae2195-0060-4b9e-b04e-56b13227141e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:29Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Creating volume 5dae2195-0060-4b9e-b04e-56b13227141e {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:31 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e202f9-4af9-4cb4-9bc1-40b02dae24ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2338536-e60e-4cf7-90f1-388b1437d224', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3eb5d6-de50-4cc3-98b6-d75993150aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=132,cinder:UPDATE=125,cinder:DELETE=7,cinder:INSERT=32 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:50:31 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e 1073741824 Sep 25 13:50:31 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:31 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume volume-c2338536-e60e-4cf7-90f1-388b1437d224 (c2338536-e60e-4cf7-90f1-388b1437d224): created successfully Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3eb5d6-de50-4cc3-98b6-d75993150aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (309e9ded-60aa-4622-8af3-10e4b1417595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-87718298-3788-4157-a2aa-a123e8a79271 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created volume successfully. Sep 25 13:50:31 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e 1073741824" returned: 0 in 0.563s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:31 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e Sep 25 13:50:31 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:32 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e" returned: 0 in 0.297s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1910143267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e30953-571b-4363-83ce-b9c1ed0c5377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3f06a96a954239a9fb327fe08f1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:30Z,use_quota=True,user_id='d344d0832a21434990c2bf6ac9a9047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Creating volume 80e30953-571b-4363-83ce-b9c1ed0c5377 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:32 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2a04b5-a198-40c5-981d-503324dfb50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dae2195-0060-4b9e-b04e-56b13227141e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:32 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 1073741824 Sep 25 13:50:32 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518babcc-7246-4173-9166-2ada08d74bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume volume-5dae2195-0060-4b9e-b04e-56b13227141e (5dae2195-0060-4b9e-b04e-56b13227141e): created successfully Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518babcc-7246-4173-9166-2ada08d74bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (e09a59dd-acb9-41e3-94dd-cd2e274ce4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-03a41500-57f8-4c82-8c9b-1dabee0e6887 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created volume successfully. Sep 25 13:50:32 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 1073741824" returned: 0 in 0.580s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:32 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 Sep 25 13:50:32 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:32 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377" returned: 0 in 0.271s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a99ca66-0c62-49ba-a7bc-6843e1b8388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e30953-571b-4363-83ce-b9c1ed0c5377', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb4d9ea-3177-429d-ba0d-1f2cf0ec0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Volume volume-80e30953-571b-4363-83ce-b9c1ed0c5377 (80e30953-571b-4363-83ce-b9c1ed0c5377): created successfully Sep 25 13:50:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb4d9ea-3177-429d-ba0d-1f2cf0ec0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Flow 'volume_create_manager' (59af5380-590c-4df8-969c-1f48feeb293a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-53de23e8-cfed-48cd-b90e-d1b7e69ea60d tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created volume successfully. Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-80e30953-571b-4363-83ce-b9c1ed0c5377-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-80e30953-571b-4363-83ce-b9c1ed0c5377-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-quobyte-80e30953-571b-4363-83ce-b9c1ed0c5377" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-80e30953-571b-4363-83ce-b9c1ed0c5377" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522b6b6-8863-453b-84c9-c315311cf9e3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:33 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 Sep 25 13:50:33 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:33 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377" returned: 0 in 0.431s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:33 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377 Sep 25 13:50:33 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:34 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-80e30953-571b-4363-83ce-b9c1ed0c5377" returned: 0 in 0.295s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-80e30953-571b-4363-83ce-b9c1ed0c5377" released by "delete_volume" :: held 0.773s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created reservations ['9446c500-6469-4284-aeb4-e5a7a331165c', 'c43c0ed8-c099-4f4e-ade9-f5838ad5a1fc', '60d2c781-76be-4907-8719-f14968033679', '2c4950fa-c07d-4383-901d-cc6c3007f278'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:34 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:34 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-5dae2195-0060-4b9e-b04e-56b13227141e-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-5dae2195-0060-4b9e-b04e-56b13227141e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-quobyte-5dae2195-0060-4b9e-b04e-56b13227141e" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-5dae2195-0060-4b9e-b04e-56b13227141e" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd03ba5-24d5-4d41-9db6-139e32436a8b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Flow 'volume_create_manager' (776e5f7f-7f0d-4ee0-9a81-231a6528fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e996879-d1b3-404f-a6a4-61e32a8d8c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e996879-d1b3-404f-a6a4-61e32a8d8c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2101315734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7787e9c-11eb-4852-b417-fca504b864ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c952a1e7cc4b7ba7526adedf9f19d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:35Z,use_quota=True,user_id='02e8f4806b0b45edb029854700e80618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1eecaf1-7bcb-48ec-8191-b0e5fd7faff7),volume_type_id=f1eecaf1-7bcb-48ec-8191-b0e5fd7faff7)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbcaaf6-44fa-4bb4-994b-7398bf4973d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbcaaf6-44fa-4bb4-994b-7398bf4973d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7783e9-97b4-4ecf-b532-41262be8f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7783e9-97b4-4ecf-b532-41262be8f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7787e9c-11eb-4852-b417-fca504b864ec', 'volume_name': 'volume-c7787e9c-11eb-4852-b417-fca504b864ec', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7418c712-a6ae-4874-8af2-c09737a79c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7418c712-a6ae-4874-8af2-c09737a79c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb0b736-6762-4c98-85d3-a079a3fc4da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:34 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Volume c7787e9c-11eb-4852-b417-fca504b864ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7787e9c-11eb-4852-b417-fca504b864ec', 'volume_size': 1} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2101315734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7787e9c-11eb-4852-b417-fca504b864ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c952a1e7cc4b7ba7526adedf9f19d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:35Z,use_quota=True,user_id='02e8f4806b0b45edb029854700e80618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1eecaf1-7bcb-48ec-8191-b0e5fd7faff7),volume_type_id=f1eecaf1-7bcb-48ec-8191-b0e5fd7faff7)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Creating volume c7787e9c-11eb-4852-b417-fca504b864ec {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:34 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:34 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.460s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Deleted volume successfully. Sep 25 13:50:34 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e Sep 25 13:50:34 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:34 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec 1073741824 Sep 25 13:50:34 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-dce0265c-9ce4-49be-a95d-14252939e49f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-80e30953-571b-4363-83ce-b9c1ed0c5377-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:35 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e" returned: 0 in 0.438s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:35 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e Sep 25 13:50:35 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:35 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec 1073741824" returned: 0 in 0.534s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:35 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:35 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec Sep 25 13:50:35 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5dae2195-0060-4b9e-b04e-56b13227141e" returned: 0 in 0.292s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-5dae2195-0060-4b9e-b04e-56b13227141e" released by "delete_volume" :: held 0.795s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created reservations ['6b8f5aec-07b7-4c78-b4c6-3df5eb6038c2', 'a755e592-2cfd-4c6d-8490-5ea53686c530', '42f47530-6886-426a-b732-ab20753f9483', 'ca6295e8-2cde-4948-9ce5-7f0e044cfa37'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:35 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:35 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:35 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-c2338536-e60e-4cf7-90f1-388b1437d224-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb0b736-6762-4c98-85d3-a079a3fc4da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7787e9c-11eb-4852-b417-fca504b864ec', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0156b1-93e5-4d4b-8d2e-0b6ef9b9ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-c2338536-e60e-4cf7-90f1-388b1437d224-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:35 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Volume volume-c7787e9c-11eb-4852-b417-fca504b864ec (c7787e9c-11eb-4852-b417-fca504b864ec): created successfully Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0156b1-93e5-4d4b-8d2e-0b6ef9b9ca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Flow 'volume_create_manager' (776e5f7f-7f0d-4ee0-9a81-231a6528fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-476f820d-c105-436d-a30f-951ecd75b5da tempest-VolumeTypesAccessTest-2013513876 None] Created volume successfully. Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-quobyte-c2338536-e60e-4cf7-90f1-388b1437d224" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-c2338536-e60e-4cf7-90f1-388b1437d224" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a6297-f0bc-44ec-89aa-741a56f18b20]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:36 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.354s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Deleted volume successfully. Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8fd7fa36-7388-47da-a63d-a237fc5e0588 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-5dae2195-0060-4b9e-b04e-56b13227141e-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:36 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 Sep 25 13:50:36 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:36 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224" returned: 0 in 0.455s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:36 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224 Sep 25 13:50:36 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:36 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c2338536-e60e-4cf7-90f1-388b1437d224" returned: 0 in 0.282s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-c2338536-e60e-4cf7-90f1-388b1437d224" released by "delete_volume" :: held 0.794s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created reservations ['57a0e5cf-22e3-4410-b7a6-0455a2a8215b', 'ef3dc103-e312-4e86-b28f-01634ebce172', '2441106c-b5b6-4e10-8c07-60cc47a3ab60', '64e2b9d6-884a-4b60-a77d-a12370060f35'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:37 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:37 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Acquiring lock "cinder-c7787e9c-11eb-4852-b417-fca504b864ec-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Lock "cinder-c7787e9c-11eb-4852-b417-fca504b864ec-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-2375f651-aef1-40af-abd8-3b02a8b9abfc-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Acquiring lock "cinder-quobyte-c7787e9c-11eb-4852-b417-fca504b864ec" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-2375f651-aef1-40af-abd8-3b02a8b9abfc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Lock "cinder-quobyte-c7787e9c-11eb-4852-b417-fca504b864ec" acquired by "delete_volume" :: waited 0.047s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0bd929-d5d7-4d6b-8183-ec379dc3ce0b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-quobyte-2375f651-aef1-40af-abd8-3b02a8b9abfc" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-2375f651-aef1-40af-abd8-3b02a8b9abfc" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc8350-0931-4639-931f-3ba550f8fa8a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:37 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.398s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:37 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec Sep 25 13:50:37 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Deleted volume successfully. Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b97e4ea-2397-4c57-a72e-74d5ac3e988f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-c2338536-e60e-4cf7-90f1-388b1437d224-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:37 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc Sep 25 13:50:37 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:37 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec" returned: 0 in 0.444s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:37 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec Sep 25 13:50:37 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:37 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc" returned: 0 in 0.468s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:37 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc Sep 25 13:50:37 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:37 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7787e9c-11eb-4852-b417-fca504b864ec" returned: 0 in 0.293s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Lock "cinder-quobyte-c7787e9c-11eb-4852-b417-fca504b864ec" released by "delete_volume" :: held 0.819s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:38 devstack cinder-volume[87220]: WARNING cinder.quota [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-167207845 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-167207845, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:38 devstack cinder-volume[87220]: WARNING cinder.quota [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-167207845 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-167207845, it is now deprecated. Please use the default quota class for default quota. Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Created reservations ['c8932c42-ee27-4eb8-abac-12a78860b55b', '6f10114f-e251-4471-aec0-5f64b26c5c8a', '9670e90d-de70-4738-a055-8b07af3b2df6', '8fa9b6ef-63c0-4ce4-b5d8-2a595c625268'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:38 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2375f651-aef1-40af-abd8-3b02a8b9abfc" returned: 0 in 0.355s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:38 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:38 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-2375f651-aef1-40af-abd8-3b02a8b9abfc" released by "delete_volume" :: held 0.886s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created reservations ['cd3cc072-7427-4a5c-a278-f760cc646bdb', 'b769b29e-b07e-435b-b98d-60f1c3fc6f6a', '457fedb1-8b8a-4bec-9178-a075d5f17d0b', '2d278730-99fe-4b6b-a39b-e3255863b402'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:38 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:38 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:38 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.356s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:38 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Deleted volume successfully. Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6282ae8e-4dba-48f0-9c07-504aa1c68ef4 tempest-VolumeTypesAccessTest-2013513876 None] Lock "cinder-c7787e9c-11eb-4852-b417-fca504b864ec-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:38 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.331s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:38 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Deleted volume successfully. Sep 25 13:50:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5eea101c-aa8f-4b3b-be4f-019e2bcb7114 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-2375f651-aef1-40af-abd8-3b02a8b9abfc-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-ea9b8742-5e4b-47b8-be5c-19d54c658d91-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-ea9b8742-5e4b-47b8-be5c-19d54c658d91-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=148,cinder:INSERT=44,cinder:UPDATE=180,cinder:DELETE=12 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-quobyte-ea9b8742-5e4b-47b8-be5c-19d54c658d91" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-ea9b8742-5e4b-47b8-be5c-19d54c658d91" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3952cb-ef9c-4ff4-956a-1ad356eb4006]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:39 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 Sep 25 13:50:39 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:39 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:39 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91 Sep 25 13:50:39 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:40 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ea9b8742-5e4b-47b8-be5c-19d54c658d91" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-ea9b8742-5e4b-47b8-be5c-19d54c658d91" released by "delete_volume" :: held 0.807s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created reservations ['1a84444b-bf72-4487-90cf-0353765829a6', 'e2d1fd89-c931-47e9-a6f7-ca9a60f0206f', 'a272456d-ab40-4c02-99c6-6463b7fc5ca3', 'e86b3617-276a-4215-b405-92b69d93d422'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:40 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:40 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-87684b04-ffd9-4a09-918c-dea60e1f6ca7-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-87684b04-ffd9-4a09-918c-dea60e1f6ca7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "cinder-quobyte-87684b04-ffd9-4a09-918c-dea60e1f6ca7" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-87684b04-ffd9-4a09-918c-dea60e1f6ca7" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bef8fab-0703-4398-b4e2-4cde68dee806]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:40 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.353s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Deleted volume successfully. Sep 25 13:50:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d9389a0d-a1f9-4e4f-be21-c03edeae029f tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-ea9b8742-5e4b-47b8-be5c-19d54c658d91-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:40 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 Sep 25 13:50:40 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:41 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7" returned: 0 in 0.486s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:41 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7 Sep 25 13:50:41 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:41 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-87684b04-ffd9-4a09-918c-dea60e1f6ca7" returned: 0 in 0.357s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-quobyte-87684b04-ffd9-4a09-918c-dea60e1f6ca7" released by "delete_volume" :: held 0.922s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Created reservations ['35551e95-d15c-4e63-a7e8-31f192f9cf30', '9dadff38-3d2f-499b-9708-efec2911f578', '1c2d75c6-10b2-4d50-b526-56e8e6475783', '1b943e3e-6533-4c6a-8981-b60e8597a8c8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:41 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:50:41 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:42 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:42 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:50:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Deleted volume successfully. Sep 25 13:50:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1d6fa5a8-3849-45bb-8a9e-4b84b4d78ee0 tempest-CreateVolumesFromSourceVolumeTest-1545929309 None] Lock "cinder-87684b04-ffd9-4a09-918c-dea60e1f6ca7-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Flow 'volume_create_manager' (744429ea-5046-4264-b96b-404e8882cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34793cf0-809e-41dd-868b-d0977aaf7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34793cf0-809e-41dd-868b-d0977aaf7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1411631477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5412467a-906b-4d7f-ab9a-dcb58185c838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8824c8394484416691067812f642449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:46Z,use_quota=True,user_id='f62c998e729145f9823e9acd064aa3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4433b83b-e4e3-479b-ab6d-a4825606b227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4433b83b-e4e3-479b-ab6d-a4825606b227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015506fb-f564-4163-a06f-d36feb2ad35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015506fb-f564-4163-a06f-d36feb2ad35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5412467a-906b-4d7f-ab9a-dcb58185c838', 'volume_name': 'volume-5412467a-906b-4d7f-ab9a-dcb58185c838', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98212525-5515-4ff7-8cdf-1ff59dabb799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98212525-5515-4ff7-8cdf-1ff59dabb799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b016ae78-0de3-42db-8278-d64fef21448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Volume 5412467a-906b-4d7f-ab9a-dcb58185c838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5412467a-906b-4d7f-ab9a-dcb58185c838', 'volume_size': 1} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1411631477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5412467a-906b-4d7f-ab9a-dcb58185c838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8824c8394484416691067812f642449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:46Z,use_quota=True,user_id='f62c998e729145f9823e9acd064aa3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Creating volume 5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:46 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:46 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 1073741824 Sep 25 13:50:46 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:46 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 1073741824" returned: 0 in 0.614s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:47 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 Sep 25 13:50:47 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:47 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838" returned: 0 in 0.332s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b016ae78-0de3-42db-8278-d64fef21448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5412467a-906b-4d7f-ab9a-dcb58185c838', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0adc8-b25b-4633-8740-4d1f4ba66b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Volume volume-5412467a-906b-4d7f-ab9a-dcb58185c838 (5412467a-906b-4d7f-ab9a-dcb58185c838): created successfully Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0adc8-b25b-4633-8740-4d1f4ba66b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Flow 'volume_create_manager' (744429ea-5046-4264-b96b-404e8882cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-65011f95-eb07-470b-b1dc-aee8ed8399b0 tempest-VolumeDependencyTests-332411137 None] Created volume successfully. Sep 25 13:50:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Creating offline snapshot 81225e60-5153-4d63-b3bf-f2b5865007d3 of volume 5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:50:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02553f0-3044-4441-a009-0dcbeeb8dea5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:48 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 Sep 25 13:50:48 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:49 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838" returned: 0 in 0.517s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:49 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 1G Sep 25 13:50:49 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:49 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 1G" returned: 0 in 0.626s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5412467a-906b-4d7f-ab9a-dcb58185c838 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:49 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5412467a-906b-4d7f-ab9a-dcb58185c838 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 Sep 25 13:50:49 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:50 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5412467a-906b-4d7f-ab9a-dcb58185c838 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3" returned: 0 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 is being set with open permissions: ugo+rw Sep 25 13:50:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:50 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 Sep 25 13:50:50 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:50 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3" returned: 0 in 0.292s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:50 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info Sep 25 13:50:50 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:50 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info is being set with open permissions: ugo+rw Sep 25 13:50:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:50 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info Sep 25 13:50:50 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:51 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.info" returned: 0 in 0.295s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1b8459f9-715d-48a7-aae6-40c2507f98bd tempest-VolumeDependencyTests-332411137 None] Create snapshot completed successfully Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Flow 'volume_create_manager' (6db72e34-3d67-4926-abf5-21d348a2e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99716aea-d37d-4c5e-8fff-4d2827f1ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99716aea-d37d-4c5e-8fff-4d2827f1ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1344519551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76b3e02-a363-4edd-b87d-a7aad64c6a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8824c8394484416691067812f642449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81225e60-5153-4d63-b3bf-f2b5865007d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:50:52Z,use_quota=True,user_id='f62c998e729145f9823e9acd064aa3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7f1e51-f235-419f-bfce-94927e660e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7f1e51-f235-419f-bfce-94927e660e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d209ffb9-00a3-4f30-a2fd-07fec6afd8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d209ffb9-00a3-4f30-a2fd-07fec6afd8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd76b3e02-a363-4edd-b87d-a7aad64c6a0f', 'volume_name': 'volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f', 'volume_size': 1, 'snapshot_id': '81225e60-5153-4d63-b3bf-f2b5865007d3'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae4248a-f799-47f5-a455-78785850cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae4248a-f799-47f5-a455-78785850cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651ad075-433c-45be-92fa-f4c23b9f60f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:50:52 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Volume d76b3e02-a363-4edd-b87d-a7aad64c6a0f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f', 'volume_size': 1, 'snapshot_id': '81225e60-5153-4d63-b3bf-f2b5865007d3'} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-quobyte-81225e60-5153-4d63-b3bf-f2b5865007d3-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-81225e60-5153-4d63-b3bf-f2b5865007d3-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Creating volume d76b3e02-a363-4edd-b87d-a7aad64c6a0f from snapshot 81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-quobyte-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] snapshot: 81225e60-5153-4d63-b3bf-f2b5865007d3, volume: d76b3e02-a363-4edd-b87d-a7aad64c6a0f, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a7bf9-f03b-4d85-9990-d1860f76b316]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:52 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 Sep 25 13:50:52 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:53 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3" returned: 0 in 0.472s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5412467a-906b-4d7f-ab9a-dcb58185c838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d58cce-1f8d-430d-8545-325472b964d5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:53 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 Sep 25 13:50:53 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:50:53 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838" returned: 0 in 0.468s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:50:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:50:53 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f Sep 25 13:50:53 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:01 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" returned: 0 in 7.675s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:51:01 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Converted 1024.00 MB image at 133.36 MB/s Sep 25 13:51:01 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f is being set with open permissions: ugo+rw Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:01 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f Sep 25 13:51:01 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:01 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" returned: 0 in 0.304s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" released by "_copy_volume_from_snapshot" :: held 9.035s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-81225e60-5153-4d63-b3bf-f2b5865007d3-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" released by "_create_volume_from_snapshot" :: held 9.116s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.134s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651ad075-433c-45be-92fa-f4c23b9f60f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f', 'volume_size': 1, 'snapshot_id': '81225e60-5153-4d63-b3bf-f2b5865007d3'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687c1aa7-fd5d-4f3b-b5aa-74eca9a559a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:01 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Volume volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f (d76b3e02-a363-4edd-b87d-a7aad64c6a0f): created successfully Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687c1aa7-fd5d-4f3b-b5aa-74eca9a559a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Flow 'volume_create_manager' (6db72e34-3d67-4926-abf5-21d348a2e173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bbb9c945-5087-4bfc-94a3-b4898c5faad2 tempest-VolumeDependencyTests-332411137 None] Created volume successfully. Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-81225e60-5153-4d63-b3bf-f2b5865007d3-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Lock "cinder-81225e60-5153-4d63-b3bf-f2b5865007d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-quobyte-5412467a-906b-4d7f-ab9a-dcb58185c838" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-5412467a-906b-4d7f-ab9a-dcb58185c838" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-quobyte-81225e60-5153-4d63-b3bf-f2b5865007d3" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-81225e60-5153-4d63-b3bf-f2b5865007d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Deleting offline snapshot 81225e60-5153-4d63-b3bf-f2b5865007d3 of volume 5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] snapshot_file for this snap is: volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d31ed9c-a3fa-495d-9f7d-83e032bf13ad]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:02 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 Sep 25 13:51:02 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:03 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3" returned: 0 in 0.500s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5412467a-906b-4d7f-ab9a-dcb58185c838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6edd96-a055-40c2-93d6-0d55ff2df8ab]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:03 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 Sep 25 13:51:03 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:03 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838" returned: 0 in 0.627s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:03 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 Sep 25 13:51:03 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:04 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:04 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3 Sep 25 13:51:04 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:04 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838.81225e60-5153-4d63-b3bf-f2b5865007d3" returned: 0 in 0.305s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-81225e60-5153-4d63-b3bf-f2b5865007d3" released by "_delete_snapshot" :: held 1.999s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-5412467a-906b-4d7f-ab9a-dcb58185c838" released by "delete_snapshot" :: held 2.032s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Created reservations ['fa5e7c09-bab7-429b-8e42-ff14e92836d1', 'a490e6d6-919a-4aa1-afcb-7045c3331707', '16b67a51-15f4-4465-a125-fea791eab036', 'a9bdb785-2618-4cbf-82e9-5c0ab7e02e8d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Delete snapshot completed successfully. Sep 25 13:51:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a669275f-831d-4798-a515-87ced705ce9d tempest-VolumeDependencyTests-332411137 None] Lock "cinder-81225e60-5153-4d63-b3bf-f2b5865007d3-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Flow 'volume_create_manager' (636eb88b-88c7-4e8c-8e06-74de7097b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f971846-b42e-4057-b0ea-16b68b05f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f971846-b42e-4057-b0ea-16b68b05f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-123022147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65de4d2-4f87-42e1-bc54-7420100f2203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a718aab4604f1db38c51101f5ce10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:05Z,use_quota=True,user_id='d1d362b41bc8432bbe50e3d9e5278ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981760a4-a7d7-49d7-a529-17eac3d95a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981760a4-a7d7-49d7-a529-17eac3d95a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d66a975-e5d5-4ecb-b08c-18d938335a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d66a975-e5d5-4ecb-b08c-18d938335a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65de4d2-4f87-42e1-bc54-7420100f2203', 'volume_name': 'volume-b65de4d2-4f87-42e1-bc54-7420100f2203', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8f5d78-c8c0-4bb4-8dac-9534b7026b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8f5d78-c8c0-4bb4-8dac-9534b7026b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c30987-f228-4240-a6c4-66fdac2d3b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Volume b65de4d2-4f87-42e1-bc54-7420100f2203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65de4d2-4f87-42e1-bc54-7420100f2203', 'volume_size': 1} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-123022147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65de4d2-4f87-42e1-bc54-7420100f2203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a718aab4604f1db38c51101f5ce10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:05Z,use_quota=True,user_id='d1d362b41bc8432bbe50e3d9e5278ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Creating volume b65de4d2-4f87-42e1-bc54-7420100f2203 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:05 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:05 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 1073741824 Sep 25 13:51:05 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-5412467a-906b-4d7f-ab9a-dcb58185c838-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Lock "cinder-5412467a-906b-4d7f-ab9a-dcb58185c838-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-quobyte-5412467a-906b-4d7f-ab9a-dcb58185c838" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-5412467a-906b-4d7f-ab9a-dcb58185c838" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e46eadb-3eb8-49bd-8358-610754700951]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:05 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 Sep 25 13:51:05 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:06 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 1073741824" returned: 0 in 0.542s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:06 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 Sep 25 13:51:06 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:06 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838" returned: 0 in 0.488s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:06 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838 Sep 25 13:51:06 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:06 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c30987-f228-4240-a6c4-66fdac2d3b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65de4d2-4f87-42e1-bc54-7420100f2203', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1c720f-3374-40b8-b251-0cabbb89b6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:06 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Volume volume-b65de4d2-4f87-42e1-bc54-7420100f2203 (b65de4d2-4f87-42e1-bc54-7420100f2203): created successfully Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1c720f-3374-40b8-b251-0cabbb89b6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Flow 'volume_create_manager' (636eb88b-88c7-4e8c-8e06-74de7097b976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d28d538a-2282-4476-9b89-b6814ff10ec3 tempest-VolumesListAdminTestJSON-1865827276 None] Created volume successfully. Sep 25 13:51:06 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5412467a-906b-4d7f-ab9a-dcb58185c838" returned: 0 in 0.313s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-5412467a-906b-4d7f-ab9a-dcb58185c838" released by "delete_volume" :: held 0.883s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Created reservations ['82a590f6-eb54-4e6e-930c-9e69e36dd9f0', '9fa8de71-88f7-4111-89ba-e3afff331207', '3a330ef8-7521-4b15-9609-b3196dc51e7b', '32c51151-37a0-4b35-afce-48463e8dcbf9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:06 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:06 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-d76b3e02-a363-4edd-b87d-a7aad64c6a0f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Lock "cinder-d76b3e02-a363-4edd-b87d-a7aad64c6a0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Acquiring lock "cinder-quobyte-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[595e2aec-d7ce-47be-9780-f2a6609f71b3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:07 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Deleted volume successfully. Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c3a7b1af-a5f2-4cdc-ab4f-8c496331a7bf tempest-VolumeDependencyTests-332411137 None] Lock "cinder-5412467a-906b-4d7f-ab9a-dcb58185c838-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:07 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f Sep 25 13:51:07 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:07 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" returned: 0 in 0.411s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:07 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f Sep 25 13:51:07 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:07 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" returned: 0 in 0.306s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Lock "cinder-quobyte-d76b3e02-a363-4edd-b87d-a7aad64c6a0f" released by "delete_volume" :: held 0.770s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:07 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Created reservations ['e3c9fc25-c23c-4424-afc8-2b61e722db94', 'f57fa85c-2ccd-405d-abb4-7ad0fd95cbc5', '03d26b4e-6ff7-40c4-aecc-0ce46b4329bb', '2eba9d69-9eac-4811-977c-5bb2c4d097d4'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:08 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:08 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Flow 'volume_create_manager' (03604252-9a45-4ab8-aea4-25687840c03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21acee11-1871-4206-8c21-538a8780dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21acee11-1871-4206-8c21-538a8780dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1483376207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25345c02-bf03-47a2-973d-8cdd16485b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a718aab4604f1db38c51101f5ce10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:08Z,use_quota=True,user_id='d1d362b41bc8432bbe50e3d9e5278ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457c3438-1870-413f-9518-f0b166b6e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457c3438-1870-413f-9518-f0b166b6e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890d3127-627a-47c2-a291-0441469b3d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890d3127-627a-47c2-a291-0441469b3d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25345c02-bf03-47a2-973d-8cdd16485b32', 'volume_name': 'volume-25345c02-bf03-47a2-973d-8cdd16485b32', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:08 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c4ee3d-e4fd-4ee3-a702-68c275e08cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c4ee3d-e4fd-4ee3-a702-68c275e08cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191699d7-791f-4b32-bf69-180ff93ffb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Volume 25345c02-bf03-47a2-973d-8cdd16485b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25345c02-bf03-47a2-973d-8cdd16485b32', 'volume_size': 1} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1483376207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25345c02-bf03-47a2-973d-8cdd16485b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a718aab4604f1db38c51101f5ce10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:08Z,use_quota=True,user_id='d1d362b41bc8432bbe50e3d9e5278ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Creating volume 25345c02-bf03-47a2-973d-8cdd16485b32 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:08 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.350s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:08 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Deleted volume successfully. Sep 25 13:51:08 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 1073741824 Sep 25 13:51:08 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fc705af5-e9cc-485c-ad91-250a123819da tempest-VolumeDependencyTests-332411137 None] Lock "cinder-d76b3e02-a363-4edd-b87d-a7aad64c6a0f-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:08 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 1073741824" returned: 0 in 0.529s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:08 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 Sep 25 13:51:08 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:09 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32" returned: 0 in 0.351s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191699d7-791f-4b32-bf69-180ff93ffb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25345c02-bf03-47a2-973d-8cdd16485b32', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b573520f-779c-48a3-85df-80b86f414c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:09 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Volume volume-25345c02-bf03-47a2-973d-8cdd16485b32 (25345c02-bf03-47a2-973d-8cdd16485b32): created successfully Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b573520f-779c-48a3-85df-80b86f414c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Flow 'volume_create_manager' (03604252-9a45-4ab8-aea4-25687840c03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-86264ae7-e078-45aa-b980-c496a3aa0141 tempest-VolumesListAdminTestJSON-1865827276 None] Created volume successfully. Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:10 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:10 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:10 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.347s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:51:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:51:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Flow 'volume_create_manager' (fbce579a-4e2e-413c-aae5-4cd11385788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5293f18d-1f0e-4dd1-871b-cab3ab79d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5293f18d-1f0e-4dd1-871b-cab3ab79d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1152240872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78084393-c4b0-4768-8c0e-4edcbc91162f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a718aab4604f1db38c51101f5ce10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:11Z,use_quota=True,user_id='d1d362b41bc8432bbe50e3d9e5278ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42c6644-31d7-4a8d-ab94-bb790cc70e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42c6644-31d7-4a8d-ab94-bb790cc70e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1e6ee7-3ec2-4931-9d13-3013b628edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1e6ee7-3ec2-4931-9d13-3013b628edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78084393-c4b0-4768-8c0e-4edcbc91162f', 'volume_name': 'volume-78084393-c4b0-4768-8c0e-4edcbc91162f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bb0a5b-38af-4847-a209-03b50ea317fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bb0a5b-38af-4847-a209-03b50ea317fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47121c4-2cad-4466-a63e-0c389b16d1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Volume 78084393-c4b0-4768-8c0e-4edcbc91162f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78084393-c4b0-4768-8c0e-4edcbc91162f', 'volume_size': 1} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1152240872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78084393-c4b0-4768-8c0e-4edcbc91162f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a718aab4604f1db38c51101f5ce10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:11Z,use_quota=True,user_id='d1d362b41bc8432bbe50e3d9e5278ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Creating volume 78084393-c4b0-4768-8c0e-4edcbc91162f {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:11 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:11 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f 1073741824 Sep 25 13:51:11 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:11 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f 1073741824" returned: 0 in 0.505s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:11 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f Sep 25 13:51:11 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Flow 'volume_create_manager' (57ac3443-3538-4e34-a58b-a66605e62632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece94a22-3dfe-4398-be26-a1d246592289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:11 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece94a22-3dfe-4398-be26-a1d246592289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9872a1d2c44b1abe2a9b48731fe703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:12Z,use_quota=True,user_id='4bef22a70d9a48c3b5e22acb139cd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a472c956-efd1-490d-bf8d-98d3182ab556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a472c956-efd1-490d-bf8d-98d3182ab556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b1e58d-da89-4c99-8e52-f8df85eb8032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b1e58d-da89-4c99-8e52-f8df85eb8032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b', 'volume_name': 'volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b458cf-1f42-46b1-9286-48440d765e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b458cf-1f42-46b1-9286-48440d765e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be68a385-0cd1-42fb-8a91-3152855c6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Volume 6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b', 'volume_size': 1} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9872a1d2c44b1abe2a9b48731fe703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:12Z,use_quota=True,user_id='4bef22a70d9a48c3b5e22acb139cd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Creating volume 6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:12 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47121c4-2cad-4466-a63e-0c389b16d1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78084393-c4b0-4768-8c0e-4edcbc91162f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b 1073741824 Sep 25 13:51:12 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8fe1bc-02ad-4b29-b189-e65ac04f3d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Volume volume-78084393-c4b0-4768-8c0e-4edcbc91162f (78084393-c4b0-4768-8c0e-4edcbc91162f): created successfully Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8fe1bc-02ad-4b29-b189-e65ac04f3d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Flow 'volume_create_manager' (fbce579a-4e2e-413c-aae5-4cd11385788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4cbe7993-c3ff-4bf2-9164-b01fc694d358 tempest-VolumesListAdminTestJSON-1865827276 None] Created volume successfully. Sep 25 13:51:12 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b 1073741824" returned: 0 in 0.466s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:12 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b Sep 25 13:51:12 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:12 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be68a385-0cd1-42fb-8a91-3152855c6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56eaa83c-11fd-4a2e-bb2f-03de99d6f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Volume volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b (6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b): created successfully Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56eaa83c-11fd-4a2e-bb2f-03de99d6f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Flow 'volume_create_manager' (57ac3443-3538-4e34-a58b-a66605e62632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-68e08866-941b-4c4a-b0f0-70ac60c2141d tempest-CinderUnicodeTest-565417678 None] Created volume successfully. Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Flow 'volume_create_manager' (2f9fc586-94c0-4365-9b95-d39094465530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d673298d-5cb6-4323-a904-5cacfe622ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d673298d-5cb6-4323-a904-5cacfe622ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb42bb9-82b2-4604-a2de-773bd0ccab27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b94f42ec1249cf98cd2296878cd069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:14Z,use_quota=True,user_id='50fe1422297a45ff9ab69c01d2b29af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e6a45f-9d6e-4b1c-b326-0b8072250837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e6a45f-9d6e-4b1c-b326-0b8072250837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c21ee10-667d-4657-bf6c-ef01aee709df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c21ee10-667d-4657-bf6c-ef01aee709df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb42bb9-82b2-4604-a2de-773bd0ccab27', 'volume_name': 'volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea01d0f-09f5-45f9-8975-88f7a7390a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea01d0f-09f5-45f9-8975-88f7a7390a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b0aaff-6cb2-4894-9a31-6978ca7e11ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:13 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Volume bdb42bb9-82b2-4604-a2de-773bd0ccab27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27', 'volume_size': 1} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb42bb9-82b2-4604-a2de-773bd0ccab27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b94f42ec1249cf98cd2296878cd069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:14Z,use_quota=True,user_id='50fe1422297a45ff9ab69c01d2b29af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Creating volume bdb42bb9-82b2-4604-a2de-773bd0ccab27 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:13 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:14 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 1073741824 Sep 25 13:51:14 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:14 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 1073741824" returned: 0 in 0.546s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:14 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 Sep 25 13:51:14 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Flow 'volume_create_manager' (c6cfd65b-296d-435c-bbfa-92631877cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63016fe7-f038-4b0c-9422-e8e81236f79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63016fe7-f038-4b0c-9422-e8e81236f79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-621544492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a04ead-ceaa-4237-bdcd-62d054872173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9872a1d2c44b1abe2a9b48731fe703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:15Z,use_quota=True,user_id='4bef22a70d9a48c3b5e22acb139cd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2f2d98-984f-47ec-b193-cf2bb514f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2f2d98-984f-47ec-b193-cf2bb514f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c36ef63-8edb-4aed-aaf1-5ca96283c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c36ef63-8edb-4aed-aaf1-5ca96283c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a04ead-ceaa-4237-bdcd-62d054872173', 'volume_name': 'volume-29a04ead-ceaa-4237-bdcd-62d054872173', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd215b2-5d51-4b8c-81f4-af44b9339470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd215b2-5d51-4b8c-81f4-af44b9339470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6689caaf-25e7-497c-b400-ac37361da897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Volume 29a04ead-ceaa-4237-bdcd-62d054872173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a04ead-ceaa-4237-bdcd-62d054872173', 'volume_size': 1} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:14 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27" returned: 0 in 0.292s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-621544492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a04ead-ceaa-4237-bdcd-62d054872173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9872a1d2c44b1abe2a9b48731fe703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:15Z,use_quota=True,user_id='4bef22a70d9a48c3b5e22acb139cd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Creating volume 29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:14 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b0aaff-6cb2-4894-9a31-6978ca7e11ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:14 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 1073741824 Sep 25 13:51:14 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f02b18-bc3c-4eff-b58b-e2adfc7dedb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Volume volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 (bdb42bb9-82b2-4604-a2de-773bd0ccab27): created successfully Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f02b18-bc3c-4eff-b58b-e2adfc7dedb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Flow 'volume_create_manager' (2f9fc586-94c0-4365-9b95-d39094465530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ffe1e809-56b4-4510-a22c-3ed6b67c5b83 tempest-VolumesListAdminTestJSON-1567375171 None] Created volume successfully. Sep 25 13:51:15 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 1073741824" returned: 0 in 0.461s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:15 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 Sep 25 13:51:15 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:15 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6689caaf-25e7-497c-b400-ac37361da897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a04ead-ceaa-4237-bdcd-62d054872173', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3bbb3c-32a3-4031-b5f2-fe38c1278ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Volume volume-29a04ead-ceaa-4237-bdcd-62d054872173 (29a04ead-ceaa-4237-bdcd-62d054872173): created successfully Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3bbb3c-32a3-4031-b5f2-fe38c1278ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Flow 'volume_create_manager' (c6cfd65b-296d-435c-bbfa-92631877cded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c0f3d97c-2697-4879-ba99-223605fb12e9 tempest-CinderUnicodeTest-565417678 None] Created volume successfully. Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Acquiring lock "cinder-bdb42bb9-82b2-4604-a2de-773bd0ccab27-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "cinder-bdb42bb9-82b2-4604-a2de-773bd0ccab27-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Acquiring lock "cinder-quobyte-bdb42bb9-82b2-4604-a2de-773bd0ccab27" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "cinder-quobyte-bdb42bb9-82b2-4604-a2de-773bd0ccab27" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[88529935-307a-48e7-becd-0e05997e2135]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "cinder-78084393-c4b0-4768-8c0e-4edcbc91162f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-78084393-c4b0-4768-8c0e-4edcbc91162f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "cinder-quobyte-78084393-c4b0-4768-8c0e-4edcbc91162f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:16 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 Sep 25 13:51:16 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-quobyte-78084393-c4b0-4768-8c0e-4edcbc91162f" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb50340c-64ab-450b-a0ec-a5ed6ad7332a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:16 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f Sep 25 13:51:16 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:16 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27" returned: 0 in 0.491s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:16 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27 Sep 25 13:51:16 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:16 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f" returned: 0 in 0.443s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:16 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f Sep 25 13:51:16 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:17 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bdb42bb9-82b2-4604-a2de-773bd0ccab27" returned: 0 in 0.362s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "cinder-quobyte-bdb42bb9-82b2-4604-a2de-773bd0ccab27" released by "delete_volume" :: held 0.913s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Creating offline snapshot 1b53b832-0fdc-49b5-9c86-514519a7970e of volume 29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0bc01-b5e1-4382-8120-ec2f5fdd5647]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Created reservations ['d403ea49-cf4f-47d6-8006-2b972c0b3f9d', '5aeab74b-5efe-4a73-887b-4b4e6b7f14aa', 'ee58f085-67dc-4367-917f-e79cf95b2228', '8222a0f6-9a1b-4b41-993a-0a53e573b16a'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:17 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-78084393-c4b0-4768-8c0e-4edcbc91162f" returned: 0 in 0.395s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-quobyte-78084393-c4b0-4768-8c0e-4edcbc91162f" released by "delete_volume" :: held 0.899s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:17 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 Sep 25 13:51:17 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Created reservations ['9a580cae-f36d-4b57-a256-55e15606ae93', '46f5a4b3-9658-4727-a8e0-0954c3fbad6c', '5871cc3d-ac08-498d-8bcf-49f5ecbf234d', '8891ac89-4933-4b1c-bf55-2e137d7729c3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:17 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:17 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:17 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:17 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:17 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173" returned: 0 in 0.514s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:17 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.349s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:17 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e 1G Sep 25 13:51:17 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Deleted volume successfully. Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3900c510-06a6-4a53-b16f-042c769ccfb1 tempest-VolumesListAdminTestJSON-1567375171 None] Lock "cinder-bdb42bb9-82b2-4604-a2de-773bd0ccab27-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:17 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.328s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Deleted volume successfully. Sep 25 13:51:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-af70b5e7-f5d7-46d2-9219-267c4a371d92 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-78084393-c4b0-4768-8c0e-4edcbc91162f-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:18 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e 1G" returned: 0 in 0.482s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a04ead-ceaa-4237-bdcd-62d054872173 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:18 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a04ead-ceaa-4237-bdcd-62d054872173 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e Sep 25 13:51:18 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:18 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a04ead-ceaa-4237-bdcd-62d054872173 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e" returned: 0 in 0.325s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:18 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e is being set with open permissions: ugo+rw Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:18 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e Sep 25 13:51:18 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "cinder-25345c02-bf03-47a2-973d-8cdd16485b32-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-25345c02-bf03-47a2-973d-8cdd16485b32-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "cinder-quobyte-25345c02-bf03-47a2-973d-8cdd16485b32" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-quobyte-25345c02-bf03-47a2-973d-8cdd16485b32" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9589d-f4e6-4937-ba02-fab6106303c7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:18 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e" returned: 0 in 0.312s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:18 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info Sep 25 13:51:18 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:18 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 Sep 25 13:51:18 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:19 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:19 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info is being set with open permissions: ugo+rw Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:19 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info Sep 25 13:51:19 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:19 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32" returned: 0 in 0.419s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:19 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32 Sep 25 13:51:19 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:19 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.info" returned: 0 in 0.277s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-75b6dc34-b48f-4710-b592-9eb1b0d05d5c tempest-CinderUnicodeTest-565417678 None] Create snapshot completed successfully Sep 25 13:51:19 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-25345c02-bf03-47a2-973d-8cdd16485b32" returned: 0 in 0.294s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-quobyte-25345c02-bf03-47a2-973d-8cdd16485b32" released by "delete_volume" :: held 0.775s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Created reservations ['b1ce2813-ef89-44ef-beee-c2831b6190c9', '5ee495ad-3381-4b30-9caa-545025237e8e', '6fc2bb7f-257e-4e76-91d9-f2142dc9ca3e', 'd5639f2d-2bb4-47b5-806f-97fbb45d9ccb'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:19 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:19 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "cinder-b65de4d2-4f87-42e1-bc54-7420100f2203-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:19 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.297s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Deleted volume successfully. Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-b65de4d2-4f87-42e1-bc54-7420100f2203-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-62a564c3-27d8-4544-aa3b-2c94d8afe72a tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-25345c02-bf03-47a2-973d-8cdd16485b32-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "cinder-quobyte-b65de4d2-4f87-42e1-bc54-7420100f2203" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-quobyte-b65de4d2-4f87-42e1-bc54-7420100f2203" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ddf8af-f2e6-40a9-a4b2-b169a86c73eb]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:20 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 Sep 25 13:51:20 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-1b53b832-0fdc-49b5-9c86-514519a7970e-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-1b53b832-0fdc-49b5-9c86-514519a7970e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-quobyte-29a04ead-ceaa-4237-bdcd-62d054872173" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-29a04ead-ceaa-4237-bdcd-62d054872173" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-quobyte-1b53b832-0fdc-49b5-9c86-514519a7970e" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-1b53b832-0fdc-49b5-9c86-514519a7970e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Deleting offline snapshot 1b53b832-0fdc-49b5-9c86-514519a7970e of volume 29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] snapshot_file for this snap is: volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0b084e-5307-46ae-984f-da6a3fcea57d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:20 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:20 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203 Sep 25 13:51:20 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:20 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e Sep 25 13:51:20 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:20 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b65de4d2-4f87-42e1-bc54-7420100f2203" returned: 0 in 0.302s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-quobyte-b65de4d2-4f87-42e1-bc54-7420100f2203" released by "delete_volume" :: held 0.788s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:20 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e" returned: 0 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a04ead-ceaa-4237-bdcd-62d054872173(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1256143a-03ae-4ad1-aa2f-c96023ccea78]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:20 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Created reservations ['3fbc91f9-89a6-4da2-aaa0-2e3ca231cbc7', '65b589b6-4e72-404c-bb6b-8e45fc588ff4', 'c3d562d4-7e89-4f04-b8cc-66f28ba46f31', '12f3b05a-d2b0-47f8-bb46-82e45d217dbd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:20 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 Sep 25 13:51:20 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:21 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:21 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:21 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173" returned: 0 in 0.486s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:21 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.319s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Deleted volume successfully. Sep 25 13:51:21 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e Sep 25 13:51:21 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6b753ef6-c0de-4706-95fc-e3e4c634ef06 tempest-VolumesListAdminTestJSON-1865827276 None] Lock "cinder-b65de4d2-4f87-42e1-bc54-7420100f2203-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:21 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:21 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e Sep 25 13:51:21 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:22 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173.1b53b832-0fdc-49b5-9c86-514519a7970e" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-1b53b832-0fdc-49b5-9c86-514519a7970e" released by "_delete_snapshot" :: held 1.760s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-29a04ead-ceaa-4237-bdcd-62d054872173" released by "delete_snapshot" :: held 1.786s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Created reservations ['8603bdb5-4e01-4a50-b54e-aaab0e999256', 'ae5a372b-bc0a-4cd6-a2fc-f62aeccf09f3', 'e1870f47-7c03-4842-b4be-ca9c09462239', '7252a7d2-aa63-47f4-aa74-49e6eee76b0e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Delete snapshot completed successfully. Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0822073d-8107-496c-88f6-649ee2b4fbf2 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-1b53b832-0fdc-49b5-9c86-514519a7970e-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-29a04ead-ceaa-4237-bdcd-62d054872173-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-29a04ead-ceaa-4237-bdcd-62d054872173-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-quobyte-29a04ead-ceaa-4237-bdcd-62d054872173" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-29a04ead-ceaa-4237-bdcd-62d054872173" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a24ad29-0c82-435a-a3d7-9ae335f750fa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:22 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 Sep 25 13:51:22 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:23 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173" returned: 0 in 0.522s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:23 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173 Sep 25 13:51:23 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:23 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-29a04ead-ceaa-4237-bdcd-62d054872173" returned: 0 in 0.313s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-29a04ead-ceaa-4237-bdcd-62d054872173" released by "delete_volume" :: held 0.926s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Created reservations ['aa9ccf93-488d-4f94-97f7-5cb5736bf6ea', '7b4b5040-a191-48b1-85c1-3971f9363163', 'c1bd92fa-8b68-450b-869e-e95e145dfcca', '1599b3ed-3747-4954-80f2-d954c73f571f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:23 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:23 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Lock "cinder-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Acquiring lock "cinder-quobyte-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8fcde5-9e78-4753-b3cb-d358fd3b56b0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:24 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Deleted volume successfully. Sep 25 13:51:24 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b Sep 25 13:51:24 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5cf34048-0b38-4217-96c8-6da69d44fb13 tempest-CinderUnicodeTest-565417678 None] Lock "cinder-29a04ead-ceaa-4237-bdcd-62d054872173-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:24 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b" returned: 0 in 0.523s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:24 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b Sep 25 13:51:24 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:24 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b" returned: 0 in 0.300s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Lock "cinder-quobyte-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b" released by "delete_volume" :: held 0.893s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Created reservations ['5ac6ed50-7a10-4130-94a1-ec360f45d5c0', 'df00863a-f401-4db3-898d-ad8a5da7d6aa', 'c3dfa6df-b18e-41df-9656-87720bfa7470', '98650c18-f5cc-440b-a43f-b3a6684dd38d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:25 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:25 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:25 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:25 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Deleted volume successfully. Sep 25 13:51:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cf08213-2d10-4fe6-b741-fea45c1ab21b tempest-CinderUnicodeTest-565417678 None] Lock "cinder-6e5d88f3-7c97-4bd5-ada3-3b84b8c7136b-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Flow 'volume_create_manager' (31169cf8-7051-4e12-807e-ced7b2e7800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98efe8ed-ee1a-4838-8e52-67dc5e9516e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98efe8ed-ee1a-4838-8e52-67dc5e9516e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-226438307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e476f09920ec4603b91f137397694d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:28Z,use_quota=True,user_id='583368345a984e35b377dbe6fa2ea53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a879d82b-d766-448e-af3d-b4c0b1235bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a879d82b-d766-448e-af3d-b4c0b1235bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6bc1fe-7c0f-4d4b-b98e-eb6976b46e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6bc1fe-7c0f-4d4b-b98e-eb6976b46e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e', 'volume_name': 'volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abcc7dd-03a8-4780-a427-4b7de1d8b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abcc7dd-03a8-4780-a427-4b7de1d8b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50650ec-b2f7-492c-a64a-f22a86a40d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Volume bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Trying to clone bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e from image a1a28988-676d-4ae6-a228-f7c326723a56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:51:28 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Image download 20.69 MB at 20.69 MB/s Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f038e63-a7c2-47d8-8578-ac02ca1be836]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:29 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD Sep 25 13:51:29 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:29 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 is fetched for user 583368345a984e35b377dbe6fa2ea53a. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[748cc28b-ff18-486f-99cd-d3a5ad919634]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:29 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD Sep 25 13:51:29 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:29 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-226438307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e476f09920ec4603b91f137397694d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:28Z,use_quota=True,user_id='583368345a984e35b377dbe6fa2ea53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Creating volume bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:29 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:29 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e 1073741824 Sep 25 13:51:29 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:30 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e 1073741824" returned: 0 in 0.557s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:30 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e Sep 25 13:51:30 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:30 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Attempting download of a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef2b450-6c53-4369-a832-cfdf13a2fb06]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:30 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v Sep 25 13:51:30 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:31 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v" returned: 0 in 0.420s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:31 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v Sep 25 13:51:31 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:31 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v" returned: 1 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_oko6as0v' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:51:31 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba6164-e348-41f5-ac21-96339c49a498]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:31 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD Sep 25 13:51:31 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:32 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:32 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] a1a28988-676d-4ae6-a228-f7c326723a56 was qcow2, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:51:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:32 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e Sep 25 13:51:32 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:34 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" returned: 0 in 2.161s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_l978fj1_devstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:51:34 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Converted 112.00 MB image at 51.81 MB/s Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:34 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e 1G Sep 25 13:51:34 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:34 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e 1G" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Downloaded image a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 for user 583368345a984e35b377dbe6fa2ea53a is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Marking volume bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=119,cinder:UPDATE=168,cinder:INSERT=42,cinder:DELETE=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Copying metadata from image a1a28988-676d-4ae6-a228-f7c326723a56 to bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Creating volume glance metadata for volume bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e backed by image a1a28988-676d-4ae6-a228-f7c326723a56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50650ec-b2f7-492c-a64a-f22a86a40d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807bc139-4c31-4470-993d-5ad4d04ad713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:34 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Volume volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e (bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e): created successfully Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807bc139-4c31-4470-993d-5ad4d04ad713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Flow 'volume_create_manager' (31169cf8-7051-4e12-807e-ced7b2e7800a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b2ae6adc-d7d6-4dcc-bfbc-901137c8ac78 tempest-VolumesImageMetadata-202357094 None] Created volume successfully. Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (92197bc0-15c0-45da-a656-875eacbe0954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56d1fc-814e-4771-bebf-403c8882ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56d1fc-814e-4771-bebf-403c8882ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551576621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2891681d-f8e4-43db-abd7-09d8783c56b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:35Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4932ea8e-3c03-4a84-b275-7b0c538e53f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4932ea8e-3c03-4a84-b275-7b0c538e53f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d35d0a6-17ae-4532-acce-08c723c71a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d35d0a6-17ae-4532-acce-08c723c71a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2891681d-f8e4-43db-abd7-09d8783c56b3', 'volume_name': 'volume-2891681d-f8e4-43db-abd7-09d8783c56b3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4c7f2c-b15d-4f30-b933-96ce8cb36f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4c7f2c-b15d-4f30-b933-96ce8cb36f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194951bc-3e49-4101-b17a-c38b31219508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:35 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Volume 2891681d-f8e4-43db-abd7-09d8783c56b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2891681d-f8e4-43db-abd7-09d8783c56b3', 'volume_size': 1} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551576621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2891681d-f8e4-43db-abd7-09d8783c56b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:35Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Creating volume 2891681d-f8e4-43db-abd7-09d8783c56b3 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:35 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:35 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 1073741824 Sep 25 13:51:35 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:36 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 1073741824" returned: 0 in 0.576s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Acquiring lock "cinder-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:36 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 Sep 25 13:51:36 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Lock "cinder-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Acquiring lock "cinder-quobyte-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Lock "cinder-quobyte-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d3933e-b814-4b04-ba3b-afc1949ced45]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:36 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e Sep 25 13:51:36 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:36 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3" returned: 0 in 0.363s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194951bc-3e49-4101-b17a-c38b31219508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2891681d-f8e4-43db-abd7-09d8783c56b3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1c928c-5e0a-477d-9ddd-7de1edbf23ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:36 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Volume volume-2891681d-f8e4-43db-abd7-09d8783c56b3 (2891681d-f8e4-43db-abd7-09d8783c56b3): created successfully Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1c928c-5e0a-477d-9ddd-7de1edbf23ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (92197bc0-15c0-45da-a656-875eacbe0954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a6917dbf-8bcc-4da1-8e32-77d2896cbbcd tempest-ProjectReaderTests-1989706886 None] Created volume successfully. Sep 25 13:51:36 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" returned: 0 in 0.405s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:36 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e Sep 25 13:51:36 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:36 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" returned: 0 in 0.264s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Lock "cinder-quobyte-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e" released by "delete_volume" :: held 0.731s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:36 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Created reservations ['7dc95211-90bc-487f-8f97-7931c2ac63f7', 'feee4536-0890-49c4-9966-40460cdd27c8', 'cf8384c0-cfca-4820-b3a7-b0ab75072743', '4e32829c-4b9a-4410-bda4-91a70f5765d1'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:37 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:37 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:37 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.280s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Deleted volume successfully. Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-10c22da4-0cb5-4f34-a7e7-42359d63ba9b tempest-VolumesImageMetadata-202357094 None] Lock "cinder-bf94bc31-9d5c-4dcd-afe0-59ee1ca9734e-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-2891681d-f8e4-43db-abd7-09d8783c56b3-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Lock "cinder-2891681d-f8e4-43db-abd7-09d8783c56b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-quobyte-2891681d-f8e4-43db-abd7-09d8783c56b3" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-2891681d-f8e4-43db-abd7-09d8783c56b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d54da-18e9-48f7-87e7-5e3f33e6d78c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:38 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 Sep 25 13:51:38 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:38 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3" returned: 0 in 0.423s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:38 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3 Sep 25 13:51:38 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:38 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2891681d-f8e4-43db-abd7-09d8783c56b3" returned: 0 in 0.331s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-2891681d-f8e4-43db-abd7-09d8783c56b3" released by "delete_volume" :: held 0.801s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Created reservations ['d6b38c45-5f09-4d62-bb3a-43665e24a95b', '570eab3a-5bdf-4896-9231-842076fda7c5', 'd0d74b74-44bf-4cd3-87d6-f5c61bc5eb90', 'df3dafe3-0022-4c9b-900a-40cc26b14b76'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:38 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:38 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:39 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Deleted volume successfully. Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1fdbfb75-fbae-4b33-b70a-57de6207937b tempest-ProjectReaderTests-1989706886 None] Lock "cinder-2891681d-f8e4-43db-abd7-09d8783c56b3-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=113,cinder:INSERT=41,cinder:UPDATE=140,cinder:DELETE=14 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (126417d2-e53f-488c-a75f-967acbf4ebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d073a976-8804-4863-b528-0ee95f3fba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d073a976-8804-4863-b528-0ee95f3fba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39404411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1dd036-c452-470b-90a7-1d56f199c495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:40Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73596986-a713-4b29-9976-17a510eb8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73596986-a713-4b29-9976-17a510eb8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b255553-436d-47ee-8468-bb296d6d78c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b255553-436d-47ee-8468-bb296d6d78c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1dd036-c452-470b-90a7-1d56f199c495', 'volume_name': 'volume-ee1dd036-c452-470b-90a7-1d56f199c495', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1118b79a-30fb-48fe-afbf-c5df8879d322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1118b79a-30fb-48fe-afbf-c5df8879d322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1467aa0-d9b7-4956-aaed-ce1ac1f3c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:39 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Volume ee1dd036-c452-470b-90a7-1d56f199c495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1dd036-c452-470b-90a7-1d56f199c495', 'volume_size': 1} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39404411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1dd036-c452-470b-90a7-1d56f199c495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:40Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Creating volume ee1dd036-c452-470b-90a7-1d56f199c495 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:39 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:39 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 1073741824 Sep 25 13:51:39 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:40 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 1073741824" returned: 0 in 0.558s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:40 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 Sep 25 13:51:40 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:40 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495" returned: 0 in 0.325s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1467aa0-d9b7-4956-aaed-ce1ac1f3c435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1dd036-c452-470b-90a7-1d56f199c495', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21faaa26-fefa-4c7e-8eba-ba8b2a9c14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Volume volume-ee1dd036-c452-470b-90a7-1d56f199c495 (ee1dd036-c452-470b-90a7-1d56f199c495): created successfully Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21faaa26-fefa-4c7e-8eba-ba8b2a9c14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (126417d2-e53f-488c-a75f-967acbf4ebcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b6ddbdfa-9f60-4774-95bf-a65f131c3392 tempest-ProjectReaderTests-1989706886 None] Created volume successfully. Sep 25 13:51:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-ee1dd036-c452-470b-90a7-1d56f199c495-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Lock "cinder-ee1dd036-c452-470b-90a7-1d56f199c495-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-quobyte-ee1dd036-c452-470b-90a7-1d56f199c495" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-ee1dd036-c452-470b-90a7-1d56f199c495" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969db29-5aa0-4641-9997-97ab3f3fefb8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:42 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 Sep 25 13:51:42 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:42 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495" returned: 0 in 0.490s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:42 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495 Sep 25 13:51:42 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:42 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ee1dd036-c452-470b-90a7-1d56f199c495" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-ee1dd036-c452-470b-90a7-1d56f199c495" released by "delete_volume" :: held 0.894s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Created reservations ['5e6aadf7-7fd2-4dab-ae5e-b50644a026cb', '3f6863d3-38fe-4784-a7ac-4f7bb826aefc', 'eb5df2c2-d042-4485-b9d0-70dc6db11ec6', 'ffe597e9-6d81-4024-81e2-e9adf10ebeab'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:43 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:43 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:43 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.354s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Deleted volume successfully. Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-97bc9d71-96a0-42f6-9d74-3442b31ae10d tempest-ProjectReaderTests-1989706886 None] Lock "cinder-ee1dd036-c452-470b-90a7-1d56f199c495-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (58da12d3-19e2-4bd8-a789-64e81f32d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29306cf8-182e-4ee0-90f3-103774a02731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29306cf8-182e-4ee0-90f3-103774a02731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174596841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8476896a-e348-485d-9734-d8c17aa92584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:44Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a6d67f-8325-4bde-99cb-f3f415c3ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a6d67f-8325-4bde-99cb-f3f415c3ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87232e6-3908-4255-b17a-eb166d6b84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87232e6-3908-4255-b17a-eb166d6b84c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8476896a-e348-485d-9734-d8c17aa92584', 'volume_name': 'volume-8476896a-e348-485d-9734-d8c17aa92584', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2075e1f5-1601-4cdb-95f8-44b44a6aabe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2075e1f5-1601-4cdb-95f8-44b44a6aabe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9e295f-0eb0-41eb-af21-4813042dbb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Volume 8476896a-e348-485d-9734-d8c17aa92584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8476896a-e348-485d-9734-d8c17aa92584', 'volume_size': 1} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174596841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8476896a-e348-485d-9734-d8c17aa92584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:44Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Creating volume 8476896a-e348-485d-9734-d8c17aa92584 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:44 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:44 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 1073741824 Sep 25 13:51:44 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:44 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 1073741824" returned: 0 in 0.547s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:44 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 Sep 25 13:51:44 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:44 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584" returned: 0 in 0.304s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9e295f-0eb0-41eb-af21-4813042dbb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8476896a-e348-485d-9734-d8c17aa92584', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f82959f-5b65-4bd3-8001-18b21f1eaca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Volume volume-8476896a-e348-485d-9734-d8c17aa92584 (8476896a-e348-485d-9734-d8c17aa92584): created successfully Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f82959f-5b65-4bd3-8001-18b21f1eaca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (58da12d3-19e2-4bd8-a789-64e81f32d035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9efe0d93-4aaf-47cf-9ac4-4cca771d87bd tempest-ProjectReaderTests-1989706886 None] Created volume successfully. Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Flow 'volume_create_manager' (f9251148-738b-4d69-a28e-9a03ca1a2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a31ffe8-ab1a-48b0-b1cb-51176ca9f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a31ffe8-ab1a-48b0-b1cb-51176ca9f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2109572035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7667c617169e4756988668f91368adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:46Z,use_quota=True,user_id='d94eb28e5ece40e093765568ef30b8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcf89b7-7443-4fb2-b7c0-30f636d9ad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcf89b7-7443-4fb2-b7c0-30f636d9ad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd0ef9d-60e0-4d09-937b-5218a13cadae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd0ef9d-60e0-4d09-937b-5218a13cadae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2', 'volume_name': 'volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa2cc5-f64d-4ad2-90b3-7b3926b8d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa2cc5-f64d-4ad2-90b3-7b3926b8d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd115e6-b92c-4b01-9474-f6a1758ae4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Volume 1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2', 'volume_size': 1} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2109572035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7667c617169e4756988668f91368adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:46Z,use_quota=True,user_id='d94eb28e5ece40e093765568ef30b8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Creating volume 1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:46 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-8476896a-e348-485d-9734-d8c17aa92584-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Lock "cinder-8476896a-e348-485d-9734-d8c17aa92584-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:46 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 1073741824 Sep 25 13:51:46 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-quobyte-8476896a-e348-485d-9734-d8c17aa92584" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-8476896a-e348-485d-9734-d8c17aa92584" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b589df-ae59-43c5-9aa7-df30f2b9a1a6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:46 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 Sep 25 13:51:46 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:46 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 1073741824" returned: 0 in 0.588s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:46 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584" returned: 0 in 0.520s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:46 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:51:46 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:46 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584 Sep 25 13:51:46 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:47 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:47 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd115e6-b92c-4b01-9474-f6a1758ae4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996e6895-c9fe-48f8-94e1-87828da2b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8476896a-e348-485d-9734-d8c17aa92584" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-8476896a-e348-485d-9734-d8c17aa92584" released by "delete_volume" :: held 0.878s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Volume volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 (1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2): created successfully Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996e6895-c9fe-48f8-94e1-87828da2b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Flow 'volume_create_manager' (f9251148-738b-4d69-a28e-9a03ca1a2b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2db19638-07e9-44dc-8e51-078483b413f7 tempest-VolumesDeleteCascade-645855632 None] Created volume successfully. Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Created reservations ['570787b0-9895-46e4-ac6f-cd22158bc8ca', '0ae7a048-5c05-4bad-9d94-2e7b29ad674f', 'a0b681d4-29d7-42dc-9bed-ee7f9628a3ee', 'e1855b4d-f5bc-4a39-b44a-91d376b6f5cd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:47 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:47 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:47 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.290s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Deleted volume successfully. Sep 25 13:51:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-db00b4c7-50d7-4ed3-aa30-cbbf5235707f tempest-ProjectReaderTests-1989706886 None] Lock "cinder-8476896a-e348-485d-9734-d8c17aa92584-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Creating offline snapshot a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf of volume 1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d66201-88b2-4db1-b2e1-e9d60b53df5d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:48 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:51:48 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:48 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.402s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:48 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf 1G Sep 25 13:51:48 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (9486af43-6a4f-40e9-b583-296d63eda0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bdefb3-74fb-4b6f-9a11-aa520d7b454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bdefb3-74fb-4b6f-9a11-aa520d7b454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304043951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2741c06-fe05-40e6-b936-2c34c936f1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:49Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35e4c73-723f-4191-be6c-e07ff770aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35e4c73-723f-4191-be6c-e07ff770aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dd9df2-a025-4a9b-a37e-67d5ad4b078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dd9df2-a025-4a9b-a37e-67d5ad4b078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2741c06-fe05-40e6-b936-2c34c936f1a1', 'volume_name': 'volume-f2741c06-fe05-40e6-b936-2c34c936f1a1', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bd06b0-ae90-4afb-a881-cc9724a0c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bd06b0-ae90-4afb-a881-cc9724a0c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d3d69b-ff62-4207-8ee6-0e88d074970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:49 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Volume f2741c06-fe05-40e6-b936-2c34c936f1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2741c06-fe05-40e6-b936-2c34c936f1a1', 'volume_size': 1} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:49 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf 1G" returned: 0 in 0.471s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:49 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:49 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:49 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.329s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:49 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf is being set with open permissions: ugo+rw Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:49 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:49 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:49 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.256s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:49 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info Sep 25 13:51:49 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:50 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info is being set with open permissions: ugo+rw Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:50 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info Sep 25 13:51:50 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:50 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.info" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304043951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2741c06-fe05-40e6-b936-2c34c936f1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a190983e9caa49419387c06edde1870d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:51:49Z,use_quota=True,user_id='26c743098c6f40249d7832eabc0b01a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Creating volume f2741c06-fe05-40e6-b936-2c34c936f1a1 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:51:50 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:50 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 1073741824 Sep 25 13:51:50 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9a6a49a3-5095-4c95-9572-613c886d5602 tempest-VolumesDeleteCascade-645855632 None] Create snapshot completed successfully Sep 25 13:51:50 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 1073741824" returned: 0 in 0.466s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:50 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 Sep 25 13:51:50 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:51 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1" returned: 0 in 0.271s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d3d69b-ff62-4207-8ee6-0e88d074970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2741c06-fe05-40e6-b936-2c34c936f1a1', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7be994-94a6-4935-b5c2-a4a4eba2417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:51:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Volume volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 (f2741c06-fe05-40e6-b936-2c34c936f1a1): created successfully Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7be994-94a6-4935-b5c2-a4a4eba2417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Flow 'volume_create_manager' (9486af43-6a4f-40e9-b583-296d63eda0c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:51:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-76ca9f5e-efd9-4b35-b27a-f22df06399c5 tempest-ProjectReaderTests-1989706886 None] Created volume successfully. Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Creating offline snapshot de21e59f-09c1-459c-8586-2aefad39a259 of volume 1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d0018-6b48-4b8e-89a1-b0eafa48de62]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:51 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:51 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:52 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:52 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 1G Sep 25 13:51:52 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-f2741c06-fe05-40e6-b936-2c34c936f1a1-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Lock "cinder-f2741c06-fe05-40e6-b936-2c34c936f1a1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "cinder-quobyte-f2741c06-fe05-40e6-b936-2c34c936f1a1" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-f2741c06-fe05-40e6-b936-2c34c936f1a1" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6d4b64-ea8b-4469-ae8e-7f74e0518b58]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:52 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 Sep 25 13:51:52 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:52 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 1G" returned: 0 in 0.514s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:52 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 Sep 25 13:51:52 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:52 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1" returned: 0 in 0.455s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:52 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1 Sep 25 13:51:52 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:53 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:53 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 is being set with open permissions: ugo+rw Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:53 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 Sep 25 13:51:53 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:53 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2741c06-fe05-40e6-b936-2c34c936f1a1" returned: 0 in 0.338s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Lock "cinder-quobyte-f2741c06-fe05-40e6-b936-2c34c936f1a1" released by "delete_volume" :: held 0.846s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Created reservations ['97a6e8a6-4fda-4eb1-984f-54e68d47c122', '6f78ada1-e5a3-4e45-973e-be4dc88264b4', 'a5cf0b85-84f2-444a-8873-f71e9d18dc08', '9c3c7c57-2fa4-40aa-a2f0-695b084c1860'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:53 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:51:53 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:53 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:51:53 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-95570f44-b4af-4219-aa5e-e1b82873a81d tempest-VolumesDeleteCascade-645855632 None] Create snapshot completed successfully Sep 25 13:51:53 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.361s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:51:53 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Deleted volume successfully. Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8cdf66c9-02df-4bcb-b416-51e58d3bf1a9 tempest-ProjectReaderTests-1989706886 None] Lock "cinder-f2741c06-fe05-40e6-b936-2c34c936f1a1-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Performing cascade delete. {{(pid=87220) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Deleting offline snapshot a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf of volume 1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] snapshot_file for this snap is: volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492be16-e38c-410d-81a4-64def136dc49]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:54 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:54 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:54 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.449s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[046af969-666e-4af2-be5b-05b9683f39d6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:54 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:51:54 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:55 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.491s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7180c912-6c91-4e32-b866-01dbe092e6a3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:55 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 Sep 25 13:51:55 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:55 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259" returned: 0 in 0.444s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79150d5-0d9e-41d0-9e08-e28fc8207d8c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:55 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:55 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:56 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.444s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac81ae5-7b1e-4f0e-b22d-6ba18103dfda]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:56 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:51:56 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:56 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.420s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:56 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:56 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:56 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:57 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf Sep 25 13:51:57 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:57 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" returned: 0 in 0.315s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 -F qcow2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:57 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 -F qcow2 Sep 25 13:51:57 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:57 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 -F qcow2" returned: 0 in 0.296s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf" released by "_delete_snapshot" :: held 3.525s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" released by "delete_snapshot" :: held 3.553s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Created reservations ['b11b6f1f-f765-4af1-be9a-25a3aa6045d6', '7dc3b870-6414-45b7-a655-0d6c2b48cb86', '9d93d4b4-afbb-49c9-a075-504c057904ea', 'a8fbef8c-b613-4507-a559-a55642a6d303'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Delete snapshot completed successfully. Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-a7c1894c-026f-4d3d-8d41-bd1c3fdbcbbf-delete_snapshot" released by "delete_snapshot" :: held 3.752s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-de21e59f-09c1-459c-8586-2aefad39a259-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-de21e59f-09c1-459c-8586-2aefad39a259-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-de21e59f-09c1-459c-8586-2aefad39a259" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-de21e59f-09c1-459c-8586-2aefad39a259" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Deleting offline snapshot de21e59f-09c1-459c-8586-2aefad39a259 of volume 1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] snapshot_file for this snap is: volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8927de6-2c2f-4c58-89d6-d580572710df]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:58 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 Sep 25 13:51:58 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:58 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259" returned: 0 in 0.411s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:51:58 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60ef6b-a44e-4c21-bda1-3c9e0cfc67c5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:58 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:51:58 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:58 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.440s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:58 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 Sep 25 13:51:58 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:59 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259" returned: 0 in 0.382s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:59 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259 Sep 25 13:51:59 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:51:59 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2.de21e59f-09c1-459c-8586-2aefad39a259" returned: 0 in 0.287s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-de21e59f-09c1-459c-8586-2aefad39a259" released by "_delete_snapshot" :: held 1.634s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" released by "delete_snapshot" :: held 1.659s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Created reservations ['387ff057-f594-4671-8296-9e096b4e53d0', '488a4389-e47d-4295-8551-35652dc63ba9', '839f23f5-064b-4ed7-ad7e-16d0f1f01912', '750cf500-2eb3-4d5b-b9c6-478dbf89f6a0'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:51:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Delete snapshot completed successfully. Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-de21e59f-09c1-459c-8586-2aefad39a259-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Snapshots deleted, issuing volume delete {{(pid=87220) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dfa334-782d-4f7c-9b57-bd42ed59f2df]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:51:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:51:59 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:51:59 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:00 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.404s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:00 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2 Sep 25 13:52:00 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:00 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" returned: 0 in 0.298s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2" released by "delete_volume" :: held 0.774s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Created reservations ['7479b109-9d30-4fe6-8e6f-44e134f9156b', '71d57ece-a325-4e91-bca6-da38b850fc5a', '78cb1bec-c98e-4bf8-bf5b-396bb0afa57e', 'e7b40bdc-8c8f-45e4-be41-111801b46c2b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:00 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:52:00 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:00 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:52:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Deleted volume successfully. Sep 25 13:52:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c6940c5f-2252-4d71-9aac-9fa5a8f34dce tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-1fa53043-d613-4dbc-9b9d-ae13ac9a2ed2-delete_volume" released by "delete_volume" :: held 7.030s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Flow 'volume_create_manager' (dde1a502-cb38-4df5-9f9e-d0acec5fbfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0b599f-ae1c-49b5-9959-47f9f6010b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0b599f-ae1c-49b5-9959-47f9f6010b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-717328165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9556d98-2c40-403d-bf9d-9b920a144bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7667c617169e4756988668f91368adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:03Z,use_quota=True,user_id='d94eb28e5ece40e093765568ef30b8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0086d4-6f9d-4ad4-88f0-1c74debd84c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0086d4-6f9d-4ad4-88f0-1c74debd84c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca53fa1e-9176-47d1-9e98-df0c16e131bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca53fa1e-9176-47d1-9e98-df0c16e131bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9556d98-2c40-403d-bf9d-9b920a144bcd', 'volume_name': 'volume-d9556d98-2c40-403d-bf9d-9b920a144bcd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c34b11-9dd1-4f30-b703-8fcc3a0500ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c34b11-9dd1-4f30-b703-8fcc3a0500ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b48008-d9cc-4eda-b29f-184440153993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Volume d9556d98-2c40-403d-bf9d-9b920a144bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9556d98-2c40-403d-bf9d-9b920a144bcd', 'volume_size': 1} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-717328165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9556d98-2c40-403d-bf9d-9b920a144bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7667c617169e4756988668f91368adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:03Z,use_quota=True,user_id='d94eb28e5ece40e093765568ef30b8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Creating volume d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:52:02 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:52:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:02 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd 1073741824 Sep 25 13:52:02 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:03 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd 1073741824" returned: 0 in 0.538s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:03 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd Sep 25 13:52:03 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:03 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd" returned: 0 in 0.297s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b48008-d9cc-4eda-b29f-184440153993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9556d98-2c40-403d-bf9d-9b920a144bcd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2604be64-efa2-4d89-a7f9-e8376ac5271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Volume volume-d9556d98-2c40-403d-bf9d-9b920a144bcd (d9556d98-2c40-403d-bf9d-9b920a144bcd): created successfully Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2604be64-efa2-4d89-a7f9-e8376ac5271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Flow 'volume_create_manager' (dde1a502-cb38-4df5-9f9e-d0acec5fbfb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ef38f8a1-1476-45ba-a912-0b7769d5219e tempest-VolumesDeleteCascade-645855632 None] Created volume successfully. Sep 25 13:52:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Creating offline snapshot 74e9372b-df30-4cad-af0b-d29b78a54784 of volume d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:52:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712f7eb-197f-40dd-9bf4-7b3b7d713e99]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:05 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd Sep 25 13:52:05 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:05 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:05 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 1G Sep 25 13:52:05 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:05 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 1G" returned: 0 in 0.512s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9556d98-2c40-403d-bf9d-9b920a144bcd -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:05 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9556d98-2c40-403d-bf9d-9b920a144bcd -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 Sep 25 13:52:05 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:06 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9556d98-2c40-403d-bf9d-9b920a144bcd -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:06 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 is being set with open permissions: ugo+rw Sep 25 13:52:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:06 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 Sep 25 13:52:06 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:06 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784" returned: 0 in 0.307s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:06 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info Sep 25 13:52:06 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:07 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info" returned: 0 in 0.350s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:07 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info is being set with open permissions: ugo+rw Sep 25 13:52:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:07 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info Sep 25 13:52:07 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:07 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.info" returned: 0 in 0.300s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e385f80f-8b35-442b-8308-65f55599a3f7 tempest-VolumesDeleteCascade-645855632 None] Create snapshot completed successfully Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Flow 'volume_create_manager' (7fd9ccaa-a784-4a29-8fff-e55bcb1dcb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0ed758-fca0-454c-a7fb-ee9c4e78e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0ed758-fca0-454c-a7fb-ee9c4e78e002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1573570595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2490cdd9-08f8-4557-910d-218912fb7f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7667c617169e4756988668f91368adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74e9372b-df30-4cad-af0b-d29b78a54784,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:09Z,use_quota=True,user_id='d94eb28e5ece40e093765568ef30b8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23be06a0-f859-45be-9a09-a3c9b92f82f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23be06a0-f859-45be-9a09-a3c9b92f82f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ba7358-5963-4d2b-a5e5-7476f4debb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ba7358-5963-4d2b-a5e5-7476f4debb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2490cdd9-08f8-4557-910d-218912fb7f48', 'volume_name': 'volume-2490cdd9-08f8-4557-910d-218912fb7f48', 'volume_size': 1, 'snapshot_id': '74e9372b-df30-4cad-af0b-d29b78a54784'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd8711c-3e6d-4d71-baa3-066e438935de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd8711c-3e6d-4d71-baa3-066e438935de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaa144b-425d-406e-ac46-076159a22358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Volume 2490cdd9-08f8-4557-910d-218912fb7f48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2490cdd9-08f8-4557-910d-218912fb7f48', 'volume_size': 1, 'snapshot_id': '74e9372b-df30-4cad-af0b-d29b78a54784'} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-74e9372b-df30-4cad-af0b-d29b78a54784-2490cdd9-08f8-4557-910d-218912fb7f48" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-74e9372b-df30-4cad-af0b-d29b78a54784-2490cdd9-08f8-4557-910d-218912fb7f48" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Creating volume 2490cdd9-08f8-4557-910d-218912fb7f48 from snapshot 74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-2490cdd9-08f8-4557-910d-218912fb7f48" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-2490cdd9-08f8-4557-910d-218912fb7f48" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] snapshot: 74e9372b-df30-4cad-af0b-d29b78a54784, volume: 2490cdd9-08f8-4557-910d-218912fb7f48, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28f554-e574-43e4-97a0-75a4b2c491cf]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:09 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 Sep 25 13:52:09 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:09 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784" returned: 0 in 0.467s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9556d98-2c40-403d-bf9d-9b920a144bcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40e7ce-48de-493e-ba63-42c8eee2b938]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:09 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd Sep 25 13:52:09 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:09 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd" returned: 0 in 0.454s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:09 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 Sep 25 13:52:09 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:09 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:52:09 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:10 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.299s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:52:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:52:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:52:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:52:16 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48" returned: 0 in 6.218s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:52:16 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Converted 1024.00 MB image at 164.67 MB/s Sep 25 13:52:16 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 is being set with open permissions: ugo+rw Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:16 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 Sep 25 13:52:16 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:16 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48" returned: 0 in 0.272s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-2490cdd9-08f8-4557-910d-218912fb7f48" released by "_copy_volume_from_snapshot" :: held 7.505s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-74e9372b-df30-4cad-af0b-d29b78a54784-2490cdd9-08f8-4557-910d-218912fb7f48" released by "_create_volume_from_snapshot" :: held 7.582s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.600s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaa144b-425d-406e-ac46-076159a22358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2490cdd9-08f8-4557-910d-218912fb7f48', 'volume_size': 1, 'snapshot_id': '74e9372b-df30-4cad-af0b-d29b78a54784'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1602c9aa-78b0-45bb-97f5-626b9e163cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:16 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Volume volume-2490cdd9-08f8-4557-910d-218912fb7f48 (2490cdd9-08f8-4557-910d-218912fb7f48): created successfully Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1602c9aa-78b0-45bb-97f5-626b9e163cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Flow 'volume_create_manager' (7fd9ccaa-a784-4a29-8fff-e55bcb1dcb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e5bf62f1-5c73-40a8-beaf-ddcfb992aee6 tempest-VolumesDeleteCascade-645855632 None] Created volume successfully. Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-d9556d98-2c40-403d-bf9d-9b920a144bcd-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-d9556d98-2c40-403d-bf9d-9b920a144bcd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Performing cascade delete. {{(pid=87220) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-74e9372b-df30-4cad-af0b-d29b78a54784-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-74e9372b-df30-4cad-af0b-d29b78a54784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-d9556d98-2c40-403d-bf9d-9b920a144bcd" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-d9556d98-2c40-403d-bf9d-9b920a144bcd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-74e9372b-df30-4cad-af0b-d29b78a54784" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-74e9372b-df30-4cad-af0b-d29b78a54784" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Deleting offline snapshot 74e9372b-df30-4cad-af0b-d29b78a54784 of volume d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] snapshot_file for this snap is: volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901e07b-b780-4f80-b18e-daa339327716]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:17 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 Sep 25 13:52:17 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:18 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9556d98-2c40-403d-bf9d-9b920a144bcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:52:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b00c48-d54c-4db7-8e9e-dfff45ea1d6f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:18 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd Sep 25 13:52:18 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:18 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd" returned: 0 in 0.664s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:19 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 Sep 25 13:52:19 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:19 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784" returned: 0 in 0.378s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:19 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784 Sep 25 13:52:19 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:19 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd.74e9372b-df30-4cad-af0b-d29b78a54784" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-74e9372b-df30-4cad-af0b-d29b78a54784" released by "_delete_snapshot" :: held 1.844s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-d9556d98-2c40-403d-bf9d-9b920a144bcd" released by "delete_snapshot" :: held 1.872s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Created reservations ['0e9b6143-1118-48a5-9a67-78484ef1ce9f', 'c531daba-4fa3-417e-8c8e-f03bc038390d', '1d4e6851-7c4c-4a5b-badc-60fba334bd1e', 'fc9bd040-ed3c-43d8-9127-bd8ebf4f94eb'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:52:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Delete snapshot completed successfully. Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-74e9372b-df30-4cad-af0b-d29b78a54784-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Snapshots deleted, issuing volume delete {{(pid=87220) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-d9556d98-2c40-403d-bf9d-9b920a144bcd" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-d9556d98-2c40-403d-bf9d-9b920a144bcd" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e645b43e-bdcb-4641-ba86-64d62cd913c8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:20 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd Sep 25 13:52:20 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:20 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd" returned: 0 in 0.422s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:20 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd Sep 25 13:52:20 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:20 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d9556d98-2c40-403d-bf9d-9b920a144bcd" returned: 0 in 0.288s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-d9556d98-2c40-403d-bf9d-9b920a144bcd" released by "delete_volume" :: held 0.796s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Created reservations ['0d75cc92-70e7-4ebf-9bce-3663932735f2', 'b2b01d47-2955-4d82-9a6c-1558a72677ba', '9b3f5129-8ca2-4419-ac07-04ca1a246892', '1b9975a2-1277-4ed2-b3b9-9fa71a56bc2f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:20 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:52:20 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:21 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:52:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Deleted volume successfully. Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1df6836d-b710-417d-a0be-94af6add1115 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-d9556d98-2c40-403d-bf9d-9b920a144bcd-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-2490cdd9-08f8-4557-910d-218912fb7f48-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-2490cdd9-08f8-4557-910d-218912fb7f48-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "cinder-quobyte-2490cdd9-08f8-4557-910d-218912fb7f48" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-2490cdd9-08f8-4557-910d-218912fb7f48" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e2fea5-b42c-4118-ac28-c920720578fc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:21 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 Sep 25 13:52:21 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:21 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48" returned: 0 in 0.461s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:21 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48 Sep 25 13:52:21 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:22 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2490cdd9-08f8-4557-910d-218912fb7f48" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-quobyte-2490cdd9-08f8-4557-910d-218912fb7f48" released by "delete_volume" :: held 0.840s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Created reservations ['43bd6430-d076-45e0-a0eb-e1c1c30e1287', 'ff09d0a6-9401-47b3-b7c0-650d3bd9a6b1', '3aa18ccf-0830-4c95-b718-e3860edaddc0', 'd0b2537e-5b89-4b63-ac90-0962e3dc9312'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:22 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:52:22 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:22 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.332s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:52:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Deleted volume successfully. Sep 25 13:52:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8d367cce-ecde-4957-a7aa-eab585e15998 tempest-VolumesDeleteCascade-645855632 None] Lock "cinder-2490cdd9-08f8-4557-910d-218912fb7f48-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Flow 'volume_create_manager' (502610cb-5cff-41a9-9e50-b3d4dcc44b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a1a2d1-1338-4b03-af7d-3ceb0dadcb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a1a2d1-1338-4b03-af7d-3ceb0dadcb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1990580454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be03304c1b84dd3932f373eed6fbed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:27Z,use_quota=True,user_id='d64b84c53aa84d4f875dd84e3d080ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8518a95a-a7b5-40c3-8cf4-89589656c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8518a95a-a7b5-40c3-8cf4-89589656c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18545c1b-df60-4e4b-b470-680617301548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18545c1b-df60-4e4b-b470-680617301548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'volume_name': 'volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ea1d0c-dda1-4b94-8e65-59be763b7778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ea1d0c-dda1-4b94-8e65-59be763b7778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6416ca-628e-4a7a-b7d5-661b0858c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:27 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Volume 5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'volume_size': 1} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1990580454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be03304c1b84dd3932f373eed6fbed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:27Z,use_quota=True,user_id='d64b84c53aa84d4f875dd84e3d080ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Creating volume 5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:52:27 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:27 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a 1073741824 Sep 25 13:52:27 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:27 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a 1073741824" returned: 0 in 0.539s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:27 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a Sep 25 13:52:27 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:28 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" returned: 0 in 0.312s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6416ca-628e-4a7a-b7d5-661b0858c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f570a1fd-303f-4020-9ac2-cb04c1e5d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Volume volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a (5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a): created successfully Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f570a1fd-303f-4020-9ac2-cb04c1e5d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Flow 'volume_create_manager' (502610cb-5cff-41a9-9e50-b3d4dcc44b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a52837d8-aab1-491e-bfe7-ddcb53fe0e02 tempest-VolumesCloneTest-1279046815 None] Created volume successfully. Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Flow 'volume_create_manager' (088ada3c-55a8-4515-a9c2-0441a34b469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bb2f44-4879-4361-9d59-2616f9d6d971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bb2f44-4879-4361-9d59-2616f9d6d971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-406506438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb3e412-e121-4645-a6e1-fdb60d9d1b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be03304c1b84dd3932f373eed6fbed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:30Z,use_quota=True,user_id='d64b84c53aa84d4f875dd84e3d080ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa73fa-cc25-400f-b6d2-fb3428317381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa73fa-cc25-400f-b6d2-fb3428317381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16a796e-721a-41bd-9fd2-f98385e198b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16a796e-721a-41bd-9fd2-f98385e198b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8fb3e412-e121-4645-a6e1-fdb60d9d1b37', 'volume_name': 'volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37', 'volume_size': 2, 'source_volid': '5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'source_volstatus': 'available'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fff030-f4d2-4f78-8db2-999ae1df32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fff030-f4d2-4f78-8db2-999ae1df32fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e8f2ad-1f3b-447d-a3d0-3fba3c4382cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Volume 8fb3e412-e121-4645-a6e1-fdb60d9d1b37: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37', 'volume_size': 2, 'source_volid': '5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'source_volstatus': 'available'} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:29 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Cloning volume 5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a to volume 8fb3e412-e121-4645-a6e1-fdb60d9d1b37 Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Creating offline snapshot 400037d1-7e34-4023-a825-3527c22b1c76 of volume 5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd8cff3-a651-42e5-a791-889ad55f986b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:30 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a Sep 25 13:52:30 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:30 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" returned: 0 in 0.456s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:30 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 1G Sep 25 13:52:30 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:30 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 1G" returned: 0 in 0.482s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:30 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 Sep 25 13:52:30 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:31 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76" returned: 0 in 0.345s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:31 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 is being set with open permissions: ugo+rw Sep 25 13:52:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:31 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 Sep 25 13:52:31 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:31 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76" returned: 0 in 0.290s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:31 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info Sep 25 13:52:31 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:31 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info" returned: 0 in 0.297s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:31 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info is being set with open permissions: ugo+rw Sep 25 13:52:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:31 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info Sep 25 13:52:31 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:32 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.info" returned: 0 in 0.306s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Acquiring lock "cinder-quobyte-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] snapshot: 400037d1-7e34-4023-a825-3527c22b1c76, volume: 8fb3e412-e121-4645-a6e1-fdb60d9d1b37, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab0fb9c-9f93-42f5-b543-ad36aa1d7bc0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:32 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 Sep 25 13:52:32 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:32 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76" returned: 0 in 0.440s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d146f5-db20-4423-8937-7e451ed7c7c7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:32 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a Sep 25 13:52:32 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:33 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" returned: 0 in 0.474s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:52:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:52:33 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:52:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:33 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 Sep 25 13:52:33 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:39 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" returned: 0 in 6.733s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:39 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:52:39 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Converted 1024.00 MB image at 152.06 MB/s Sep 25 13:52:39 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 is being set with open permissions: ugo+rw Sep 25 13:52:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:40 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 Sep 25 13:52:40 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:40 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" returned: 0 in 0.261s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" released by "_copy_volume_from_snapshot" :: held 8.000s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:INSERT=35,cinder:SELECT=89,cinder:UPDATE=115,cinder:DELETE=14 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Acquiring lock "cinder-quobyte-400037d1-7e34-4023-a825-3527c22b1c76" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-400037d1-7e34-4023-a825-3527c22b1c76" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Deleting offline snapshot 400037d1-7e34-4023-a825-3527c22b1c76 of volume 5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] snapshot_file for this snap is: volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[933622f6-def7-4187-8eab-d57429d02372]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:40 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 Sep 25 13:52:40 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:40 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76" returned: 0 in 0.412s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d9099-14b8-4204-990b-cc1f728472e3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:40 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a Sep 25 13:52:40 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:41 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" returned: 0 in 0.587s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:41 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 Sep 25 13:52:41 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:41 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=75,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=5 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:52:41 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76" returned: 0 in 0.350s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:41 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76 Sep 25 13:52:41 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:42 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a.400037d1-7e34-4023-a825-3527c22b1c76" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-400037d1-7e34-4023-a825-3527c22b1c76" released by "_delete_snapshot" :: held 1.739s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.144s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e8f2ad-1f3b-447d-a3d0-3fba3c4382cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37', 'volume_size': 2, 'source_volid': '5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a', 'source_volstatus': 'available'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2ac189-9d39-4bc4-b39d-f13cc13c78e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:42 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Volume volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 (8fb3e412-e121-4645-a6e1-fdb60d9d1b37): created successfully Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2ac189-9d39-4bc4-b39d-f13cc13c78e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Flow 'volume_create_manager' (088ada3c-55a8-4515-a9c2-0441a34b469f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b4eda2e8-8898-40ec-9eaf-8289b64ee40f tempest-VolumesCloneTest-1279046815 None] Created volume successfully. Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "cinder-8fb3e412-e121-4645-a6e1-fdb60d9d1b37-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-8fb3e412-e121-4645-a6e1-fdb60d9d1b37-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "cinder-quobyte-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5ec66a-2954-46a5-b328-a18a058691c5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:43 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 Sep 25 13:52:43 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:43 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" returned: 0 in 0.445s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:43 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37 Sep 25 13:52:43 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:44 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-8fb3e412-e121-4645-a6e1-fdb60d9d1b37" released by "delete_volume" :: held 0.773s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Created reservations ['548acadc-2bd7-42df-9012-fe62921ee931', 'f5d2c12f-009d-481b-ad79-e5393cb15797', '116c3656-768d-4e77-8ed3-4487841deded', '319ec6e8-df08-4e80-baaa-c4fe5c2e3bc5'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:44 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:52:44 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "cinder-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:44 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.343s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:52:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Deleted volume successfully. Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "cinder-quobyte-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2552c988-6263-41bd-811a-c2b9ab076d26 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-8fb3e412-e121-4645-a6e1-fdb60d9d1b37-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c316bfa-8822-441f-a8e4-1f7daed5ae8f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:52:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:44 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a Sep 25 13:52:44 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:45 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" returned: 0 in 0.420s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:45 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a Sep 25 13:52:45 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:45 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" returned: 0 in 0.273s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-quobyte-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a" released by "delete_volume" :: held 0.772s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Created reservations ['5231393e-6883-4f37-ac0d-a7bdddc19ad1', '591c5b7f-f5ad-40f3-9f17-6d14204c21be', '9f1134e2-2072-472f-ad77-5851553d95cb', '5da15e46-4236-4440-b7f4-9dc80e9f1683'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:45 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:52:45 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:45 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.336s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:52:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Deleted volume successfully. Sep 25 13:52:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0e995051-981c-41b3-abcd-15d61a044840 tempest-VolumesCloneTest-1279046815 None] Lock "cinder-5f3f208e-cc9e-4495-a3de-cb4e44f3ab4a-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Flow 'volume_create_manager' (906e24e0-2245-486a-a95b-6cdfa757a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428bf7e4-7b1c-403c-a290-3674d3187050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428bf7e4-7b1c-403c-a290-3674d3187050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107041213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd360e4-4f28-427a-8dbd-79a95af9fcdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbf9bf19334e31a0c1b4920f275757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:50Z,use_quota=True,user_id='3e8a88d2c4674e9fa71247f4d5a4a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a860ccf-0409-42ac-b39a-7e92815530d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a860ccf-0409-42ac-b39a-7e92815530d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9978b5a5-6480-4996-9033-65755e8200f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9978b5a5-6480-4996-9033-65755e8200f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd360e4-4f28-427a-8dbd-79a95af9fcdd', 'volume_name': 'volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ad915e-61bf-4d0a-b063-37b71ac630ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ad915e-61bf-4d0a-b063-37b71ac630ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6148e7c6-36ec-4317-8e40-52ec487fc86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:50 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Volume 4fd360e4-4f28-427a-8dbd-79a95af9fcdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd', 'volume_size': 1} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107041213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd360e4-4f28-427a-8dbd-79a95af9fcdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbf9bf19334e31a0c1b4920f275757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:50Z,use_quota=True,user_id='3e8a88d2c4674e9fa71247f4d5a4a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Creating volume 4fd360e4-4f28-427a-8dbd-79a95af9fcdd {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:52:50 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:50 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd 1073741824 Sep 25 13:52:50 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:50 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd 1073741824" returned: 0 in 0.518s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:50 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd Sep 25 13:52:50 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:51 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd" returned: 0 in 0.280s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6148e7c6-36ec-4317-8e40-52ec487fc86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5846710c-c654-42cd-8f09-2cc606c9ce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Volume volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd (4fd360e4-4f28-427a-8dbd-79a95af9fcdd): created successfully Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5846710c-c654-42cd-8f09-2cc606c9ce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Flow 'volume_create_manager' (906e24e0-2245-486a-a95b-6cdfa757a171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-90166897-1fd0-44d2-a38a-8a705997d066 tempest-VolumesListTestJSON-915443248 None] Created volume successfully. Sep 25 13:52:52 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Flow 'volume_create_manager' (2b5a101b-c61a-4b52-8bf9-50e1a052dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dc51c4-6311-42c8-b6d9-3a5a1574d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dc51c4-6311-42c8-b6d9-3a5a1574d828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2124760860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287201c1-d6ee-4907-b530-3327133b2160,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbf9bf19334e31a0c1b4920f275757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:53Z,use_quota=True,user_id='3e8a88d2c4674e9fa71247f4d5a4a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6add860b-8e33-4499-a169-a9d8ec489540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6add860b-8e33-4499-a169-a9d8ec489540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e51ee0-04ee-4fb8-971b-e37d7c86271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e51ee0-04ee-4fb8-971b-e37d7c86271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287201c1-d6ee-4907-b530-3327133b2160', 'volume_name': 'volume-287201c1-d6ee-4907-b530-3327133b2160', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68b361d-eff5-448c-972e-7d2665603cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68b361d-eff5-448c-972e-7d2665603cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa84258-8116-4582-a622-97524de4a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:53 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Volume 287201c1-d6ee-4907-b530-3327133b2160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287201c1-d6ee-4907-b530-3327133b2160', 'volume_size': 1} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2124760860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287201c1-d6ee-4907-b530-3327133b2160,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbf9bf19334e31a0c1b4920f275757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:53Z,use_quota=True,user_id='3e8a88d2c4674e9fa71247f4d5a4a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Creating volume 287201c1-d6ee-4907-b530-3327133b2160 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:52:53 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:53 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 1073741824 Sep 25 13:52:53 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:53 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 1073741824" returned: 0 in 0.460s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:53 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 Sep 25 13:52:53 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:53 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa84258-8116-4582-a622-97524de4a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287201c1-d6ee-4907-b530-3327133b2160', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266e020d-b389-457b-a045-ff3b4e16dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:53 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Volume volume-287201c1-d6ee-4907-b530-3327133b2160 (287201c1-d6ee-4907-b530-3327133b2160): created successfully Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266e020d-b389-457b-a045-ff3b4e16dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:53 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Flow 'volume_create_manager' (2b5a101b-c61a-4b52-8bf9-50e1a052dfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:53 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3b0f1c81-7dbd-49e4-b739-30a9e011076d tempest-VolumesListTestJSON-915443248 None] Created volume successfully. Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Flow 'volume_create_manager' (72c734df-df29-4a1a-8447-b28e9688bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a2bdec-45af-4b80-9676-972837ae6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a2bdec-45af-4b80-9676-972837ae6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-814594400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9dc463-3e96-48bd-99ce-b2246081271a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbf9bf19334e31a0c1b4920f275757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:56Z,use_quota=True,user_id='3e8a88d2c4674e9fa71247f4d5a4a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12fe0b8-05bd-47e8-a68b-3286a335388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12fe0b8-05bd-47e8-a68b-3286a335388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff61af2-ed0a-4d8e-93dc-64ab62e28b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff61af2-ed0a-4d8e-93dc-64ab62e28b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9dc463-3e96-48bd-99ce-b2246081271a', 'volume_name': 'volume-3f9dc463-3e96-48bd-99ce-b2246081271a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0640e641-cf8e-41da-a85a-47512441a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0640e641-cf8e-41da-a85a-47512441a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ae3491-3ce2-463d-80a2-16d3739ce34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:56 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Volume 3f9dc463-3e96-48bd-99ce-b2246081271a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9dc463-3e96-48bd-99ce-b2246081271a', 'volume_size': 1} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-814594400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9dc463-3e96-48bd-99ce-b2246081271a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbf9bf19334e31a0c1b4920f275757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:52:56Z,use_quota=True,user_id='3e8a88d2c4674e9fa71247f4d5a4a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Creating volume 3f9dc463-3e96-48bd-99ce-b2246081271a {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:52:56 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:56 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a 1073741824 Sep 25 13:52:56 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:56 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a 1073741824" returned: 0 in 0.507s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:52:56 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a Sep 25 13:52:56 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:52:57 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a" returned: 0 in 0.255s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ae3491-3ce2-463d-80a2-16d3739ce34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9dc463-3e96-48bd-99ce-b2246081271a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de55c00-89a4-4b7e-9b95-b480d13e32d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:52:57 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Volume volume-3f9dc463-3e96-48bd-99ce-b2246081271a (3f9dc463-3e96-48bd-99ce-b2246081271a): created successfully Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de55c00-89a4-4b7e-9b95-b480d13e32d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:52:57 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Flow 'volume_create_manager' (72c734df-df29-4a1a-8447-b28e9688bf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:52:57 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-864c0be4-925a-49f9-90b5-410791540fa1 tempest-VolumesListTestJSON-915443248 None] Created volume successfully. Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Acquiring lock "cinder-3f9dc463-3e96-48bd-99ce-b2246081271a-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Lock "cinder-3f9dc463-3e96-48bd-99ce-b2246081271a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Acquiring lock "cinder-quobyte-3f9dc463-3e96-48bd-99ce-b2246081271a" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Lock "cinder-quobyte-3f9dc463-3e96-48bd-99ce-b2246081271a" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86c5031-5db8-4291-a48c-f8b5ac9193b4]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:00 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a Sep 25 13:53:00 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:00 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a" returned: 0 in 0.446s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:00 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a Sep 25 13:53:00 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:00 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3f9dc463-3e96-48bd-99ce-b2246081271a" returned: 0 in 0.281s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Lock "cinder-quobyte-3f9dc463-3e96-48bd-99ce-b2246081271a" released by "delete_volume" :: held 0.776s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Created reservations ['7d643689-8978-4fab-b4e1-ef5123629445', '3c7d0211-4643-4d3e-a926-d395f65d64ea', '3e7bc650-9b29-4fdf-afee-ae2bac79b2d6', 'e3107c98-8236-4950-a3ce-15ebe51ca6eb'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:01 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:53:01 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "cinder-287201c1-d6ee-4907-b530-3327133b2160-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Lock "cinder-287201c1-d6ee-4907-b530-3327133b2160-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:53:01 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "cinder-quobyte-287201c1-d6ee-4907-b530-3327133b2160" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:53:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Deleted volume successfully. Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Lock "cinder-quobyte-287201c1-d6ee-4907-b530-3327133b2160" acquired by "delete_volume" :: waited 0.029s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-533d61a7-71c5-416f-b784-7ed0c99075ed tempest-VolumesListTestJSON-915443248 None] Lock "cinder-3f9dc463-3e96-48bd-99ce-b2246081271a-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[be51c911-9a94-4be0-9c46-a50e9b6f046d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:01 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 Sep 25 13:53:01 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:01 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160" returned: 0 in 0.452s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:01 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160 Sep 25 13:53:01 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:02 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-287201c1-d6ee-4907-b530-3327133b2160" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Lock "cinder-quobyte-287201c1-d6ee-4907-b530-3327133b2160" released by "delete_volume" :: held 0.808s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Created reservations ['b2fd2709-eb17-48ac-8732-983a5a9fa0d8', '141ba57d-ab10-4fda-98ed-86855f2348f1', '32b063ad-aa47-45c6-82fd-e4e5c74a8595', '7203915c-8204-4539-9ceb-8fafd3e74976'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:02 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:53:02 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Acquiring lock "cinder-4fd360e4-4f28-427a-8dbd-79a95af9fcdd-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Lock "cinder-4fd360e4-4f28-427a-8dbd-79a95af9fcdd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:53:02 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Acquiring lock "cinder-quobyte-4fd360e4-4f28-427a-8dbd-79a95af9fcdd" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.298s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:53:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Deleted volume successfully. Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Lock "cinder-quobyte-4fd360e4-4f28-427a-8dbd-79a95af9fcdd" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2297e8e9-4e9b-4ee1-903c-9493989c2452 tempest-VolumesListTestJSON-915443248 None] Lock "cinder-287201c1-d6ee-4907-b530-3327133b2160-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[621293ef-ccd6-4109-a9f5-7f3ba6370245]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:53:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:02 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd Sep 25 13:53:02 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:03 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd" returned: 0 in 0.438s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:03 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd Sep 25 13:53:03 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:03 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4fd360e4-4f28-427a-8dbd-79a95af9fcdd" returned: 0 in 0.276s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Lock "cinder-quobyte-4fd360e4-4f28-427a-8dbd-79a95af9fcdd" released by "delete_volume" :: held 0.769s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Created reservations ['c12436fd-8fe3-4106-9540-400d5e270690', '899ae3b6-df54-41ad-af29-a48a5757460e', '3956701c-cd4f-4421-8510-a391c0c144bf', '75fe5797-8559-49bb-9dfb-ee835219a890'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:03 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:53:03 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:03 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.309s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:03 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:53:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Deleted volume successfully. Sep 25 13:53:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9a6cfab-6382-41f9-a841-0125626f3f3c tempest-VolumesListTestJSON-915443248 None] Lock "cinder-4fd360e4-4f28-427a-8dbd-79a95af9fcdd-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:09 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:53:09 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:10 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:53:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:53:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:53:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:53:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=52,cinder:SELECT=33,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:53:14 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=53,cinder:DELETE=8,cinder:SELECT=32,cinder:INSERT=12 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Flow 'volume_create_manager' (cded5193-7163-45f9-b5c3-f9018e7389b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e6fa26-dd04-4e42-b57b-2f87bde27f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e6fa26-dd04-4e42-b57b-2f87bde27f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2122275114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a335c3a-3bbf-4949-a2e4-6060987baff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539f353dbe32466fb7473976c1a19caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:53:43Z,use_quota=True,user_id='9484220f352e40c79f8bb7589a9bab71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8bbe74-7af4-4156-b47d-cbe27f657619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8bbe74-7af4-4156-b47d-cbe27f657619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac979b6-9272-4eb0-81bf-b3d70e77f4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac979b6-9272-4eb0-81bf-b3d70e77f4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a335c3a-3bbf-4949-a2e4-6060987baff2', 'volume_name': 'volume-0a335c3a-3bbf-4949-a2e4-6060987baff2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5593700-c612-45db-b29e-9a4e49c0dbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5593700-c612-45db-b29e-9a4e49c0dbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09539227-b89b-4998-9650-7761ce13112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:53:42 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Volume 0a335c3a-3bbf-4949-a2e4-6060987baff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a335c3a-3bbf-4949-a2e4-6060987baff2', 'volume_size': 1} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2122275114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a335c3a-3bbf-4949-a2e4-6060987baff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539f353dbe32466fb7473976c1a19caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:53:43Z,use_quota=True,user_id='9484220f352e40c79f8bb7589a9bab71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Creating volume 0a335c3a-3bbf-4949-a2e4-6060987baff2 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:53:42 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:53:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:42 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 1073741824 Sep 25 13:53:42 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:43 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 1073741824" returned: 0 in 0.502s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:53:43 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 Sep 25 13:53:43 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:53:43 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2" returned: 0 in 0.309s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09539227-b89b-4998-9650-7761ce13112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a335c3a-3bbf-4949-a2e4-6060987baff2', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94f19af-ce91-4ac6-86af-5a8654945edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:53:43 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Volume volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 (0a335c3a-3bbf-4949-a2e4-6060987baff2): created successfully Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94f19af-ce91-4ac6-86af-5a8654945edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:53:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Flow 'volume_create_manager' (cded5193-7163-45f9-b5c3-f9018e7389b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:53:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8baa3a01-644f-4587-841e-54b24d0dcee4 tempest-TestMinimumBasicScenario-630913553 None] Created volume successfully. Sep 25 13:53:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-044b39cb-8869-4478-8f72-132c034deae4 req-f14d5591-9cea-4c7b-be06-514c4cc5c69d tempest-TestMinimumBasicScenario-630913553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:53:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-044b39cb-8869-4478-8f72-132c034deae4 req-f14d5591-9cea-4c7b-be06-514c4cc5c69d tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:53:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-044b39cb-8869-4478-8f72-132c034deae4 req-f14d5591-9cea-4c7b-be06-514c4cc5c69d tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:53:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-044b39cb-8869-4478-8f72-132c034deae4 req-f14d5591-9cea-4c7b-be06-514c4cc5c69d tempest-TestMinimumBasicScenario-630913553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-0a335c3a-3bbf-4949-a2e4-6060987baff2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95981260-b0e0-4398-8812-ef9ae85612f5', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:53:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-044b39cb-8869-4478-8f72-132c034deae4 req-f14d5591-9cea-4c7b-be06-514c4cc5c69d tempest-TestMinimumBasicScenario-630913553 None] attachment_update completed successfully. Sep 25 13:53:55 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:53:55 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:54:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:54:09 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:54:10 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:54:10 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 25 13:54:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.346s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:54:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:54:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:54:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:54:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:54:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-1e120bb2-649e-429d-9785-05eeede1f9fb req-6aa9653f-31ff-4617-b245-4e5c545e8a7e tempest-TestMinimumBasicScenario-630913553 None] Terminate volume connection completed successfully. Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-1e120bb2-649e-429d-9785-05eeede1f9fb req-6aa9653f-31ff-4617-b245-4e5c545e8a7e tempest-TestMinimumBasicScenario-630913553 None] Deleting attachment 95981260-b0e0-4398-8812-ef9ae85612f5. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Acquiring lock "cinder-0a335c3a-3bbf-4949-a2e4-6060987baff2-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Lock "cinder-0a335c3a-3bbf-4949-a2e4-6060987baff2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Acquiring lock "cinder-quobyte-0a335c3a-3bbf-4949-a2e4-6060987baff2" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Lock "cinder-quobyte-0a335c3a-3bbf-4949-a2e4-6060987baff2" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bebd2d-0c64-44d7-a409-db151b9464d4]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:54:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:54:38 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 Sep 25 13:54:38 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:54:38 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2" returned: 0 in 0.456s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:54:38 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2 Sep 25 13:54:38 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:54:38 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0a335c3a-3bbf-4949-a2e4-6060987baff2" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Lock "cinder-quobyte-0a335c3a-3bbf-4949-a2e4-6060987baff2" released by "delete_volume" :: held 0.781s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Created reservations ['29288b50-9aad-4623-91e5-4561283eeb27', 'c42ecda8-fb15-4ab3-8751-3856941110f6', '7d0c62a1-1da3-4528-9c18-8eb4f4b66286', 'ab86b7ae-d5c1-464a-9ccc-d16d0bf2c9d8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:54:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:54:38 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:54:38 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:54:39 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 25 13:54:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.315s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:54:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:54:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Deleted volume successfully. Sep 25 13:54:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c63d95f8-e55e-4ec3-bbea-819bc88ae7ef tempest-TestMinimumBasicScenario-630913553 None] Lock "cinder-0a335c3a-3bbf-4949-a2e4-6060987baff2-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:54:48 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:54:49 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:55:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:55:10 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:55:10 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:55:10 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 25 13:55:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.383s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:55:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:55:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:55:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:55:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:55:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:55:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Flow 'volume_create_manager' (dc5def62-3396-4469-b410-14f28de3987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0985cc5b-3186-4654-8daf-68c1bb47e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0985cc5b-3186-4654-8daf-68c1bb47e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-859507589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cfcbf9-24c6-4420-9ab5-dfcc919e41fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b2ce3d494bb4d548ae150d6cc473103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:55:55Z,use_quota=True,user_id='626f50806ccf41a18e3f0081099ee2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4370bee-5ca6-4749-ae3e-933251149bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4370bee-5ca6-4749-ae3e-933251149bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dc6b23-208e-4b41-8fd1-b79f667f6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dc6b23-208e-4b41-8fd1-b79f667f6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cfcbf9-24c6-4420-9ab5-dfcc919e41fa', 'volume_name': 'volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f53108-5781-48a3-bcd8-67f3e9602e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f53108-5781-48a3-bcd8-67f3e9602e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bca6b-211b-4bb1-94d8-3f1c51863b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:55:55 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Volume 88cfcbf9-24c6-4420-9ab5-dfcc919e41fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa', 'volume_size': 1} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-859507589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cfcbf9-24c6-4420-9ab5-dfcc919e41fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b2ce3d494bb4d548ae150d6cc473103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:55:55Z,use_quota=True,user_id='626f50806ccf41a18e3f0081099ee2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Creating volume 88cfcbf9-24c6-4420-9ab5-dfcc919e41fa {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:55:55 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:55:55 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa 1073741824 Sep 25 13:55:55 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:55:55 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa 1073741824" returned: 0 in 0.526s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:55:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:55:55 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa Sep 25 13:55:55 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:55:56 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bca6b-211b-4bb1-94d8-3f1c51863b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db84f04d-9881-4b7c-8468-0dcbc307fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:55:56 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Volume volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa (88cfcbf9-24c6-4420-9ab5-dfcc919e41fa): created successfully Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db84f04d-9881-4b7c-8468-0dcbc307fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:55:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Flow 'volume_create_manager' (dc5def62-3396-4469-b410-14f28de3987b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:55:56 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a1d9399a-e593-453d-a061-c02448c92f32 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Created volume successfully. Sep 25 13:55:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-fcc5c006-db86-4b60-b055-30fd58289498 req-f6ee34c0-cca3-48de-85bf-58804b7f5ac5 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:55:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-fcc5c006-db86-4b60-b055-30fd58289498 req-f6ee34c0-cca3-48de-85bf-58804b7f5ac5 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:55:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-fcc5c006-db86-4b60-b055-30fd58289498 req-f6ee34c0-cca3-48de-85bf-58804b7f5ac5 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:55:58 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-fcc5c006-db86-4b60-b055-30fd58289498 req-f6ee34c0-cca3-48de-85bf-58804b7f5ac5 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f82e892-4ad6-40cd-98b6-0f477b9b0184', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:55:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-fcc5c006-db86-4b60-b055-30fd58289498 req-f6ee34c0-cca3-48de-85bf-58804b7f5ac5 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] attachment_update completed successfully. Sep 25 13:56:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-4bd371d0-d30f-4da1-8809-a11e7708b7aa req-9539572c-4642-41dd-9679-cf112551f774 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Terminate volume connection completed successfully. Sep 25 13:56:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-4bd371d0-d30f-4da1-8809-a11e7708b7aa req-9539572c-4642-41dd-9679-cf112551f774 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Deleting attachment 8f82e892-4ad6-40cd-98b6-0f477b9b0184. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:56:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Acquiring lock "cinder-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:56:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "cinder-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:56:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Acquiring lock "cinder-quobyte-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:56:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "cinder-quobyte-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:56:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1987d6b5-4686-4650-84b5-fb4b6d1e3985]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:56:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:02 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa Sep 25 13:56:02 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:03 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa" returned: 0 in 0.466s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:03 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa Sep 25 13:56:03 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:03 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa" returned: 0 in 0.301s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "cinder-quobyte-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa" released by "delete_volume" :: held 0.818s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Created reservations ['c14f4a34-322d-4336-b5f5-a16e551b3f23', 'f0c269ae-8e56-4bdb-8026-b87d913c2410', 'b78252a2-4ded-4b7a-a9ce-cf1449f08322', '1274a5b0-a1a2-466f-a4a6-97ce01157d28'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:56:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:03 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:56:03 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:04 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:04 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:56:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Deleted volume successfully. Sep 25 13:56:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7b1e1473-8624-4e04-a9a9-29db178f51d4 tempest-TestServerVolumeAttachScenarioOldVersion-234805020 None] Lock "cinder-88cfcbf9-24c6-4420-9ab5-dfcc919e41fa-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:56:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:10 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:56:10 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:10 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.363s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:56:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:56:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:56:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:56:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=14,cinder:INSERT=3,cinder:SELECT=12 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:56:14 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Flow 'volume_create_manager' (cd5daab1-f428-492b-8417-d3e9818c2b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356d494f-791f-4c57-802f-066ffc22194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356d494f-791f-4c57-802f-066ffc22194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-239085205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e963fea-02c9-46f0-b78d-b66647d61d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd1c08ea62c4e29906d40da5d99121a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:56:46Z,use_quota=True,user_id='456d3650e490457d9783e1d513c11ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35341a84-bb8c-423a-aea9-f1aaf8486b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35341a84-bb8c-423a-aea9-f1aaf8486b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0006ebb-5260-4730-9893-9735d0f74970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0006ebb-5260-4730-9893-9735d0f74970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e963fea-02c9-46f0-b78d-b66647d61d16', 'volume_name': 'volume-0e963fea-02c9-46f0-b78d-b66647d61d16', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d93cb3-1544-4f6a-afbf-7e59517c3b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d93cb3-1544-4f6a-afbf-7e59517c3b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227d1d9b-a300-4719-95cc-24941f61bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Volume 0e963fea-02c9-46f0-b78d-b66647d61d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e963fea-02c9-46f0-b78d-b66647d61d16', 'volume_size': 1} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-239085205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e963fea-02c9-46f0-b78d-b66647d61d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd1c08ea62c4e29906d40da5d99121a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:56:46Z,use_quota=True,user_id='456d3650e490457d9783e1d513c11ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Creating volume 0e963fea-02c9-46f0-b78d-b66647d61d16 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:56:46 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:46 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 1073741824 Sep 25 13:56:46 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Flow 'volume_create_manager' (e10dbe1e-d97d-4214-b9ad-ac3f28dce368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffad8718-e008-47e8-ba97-1916eba3d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffad8718-e008-47e8-ba97-1916eba3d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-743832296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1969bd64-4379-446a-b494-45199ad6d9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd1c08ea62c4e29906d40da5d99121a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:56:47Z,use_quota=True,user_id='456d3650e490457d9783e1d513c11ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a1c107-92c8-4bbc-a9ee-e90513ac6942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a1c107-92c8-4bbc-a9ee-e90513ac6942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83813454-1aa8-4e38-9e11-0d4f881122ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83813454-1aa8-4e38-9e11-0d4f881122ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1969bd64-4379-446a-b494-45199ad6d9ab', 'volume_name': 'volume-1969bd64-4379-446a-b494-45199ad6d9ab', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1de3d69-190f-4821-ad89-22c63c22e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1de3d69-190f-4821-ad89-22c63c22e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77a09f0-07dc-4450-8643-472b91595f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Volume 1969bd64-4379-446a-b494-45199ad6d9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1969bd64-4379-446a-b494-45199ad6d9ab', 'volume_size': 1} Sep 25 13:56:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:56:47 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 1073741824" returned: 0 in 0.604s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:47 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 Sep 25 13:56:47 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:47 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16" returned: 0 in 0.333s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-743832296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1969bd64-4379-446a-b494-45199ad6d9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd1c08ea62c4e29906d40da5d99121a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:56:47Z,use_quota=True,user_id='456d3650e490457d9783e1d513c11ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Creating volume 1969bd64-4379-446a-b494-45199ad6d9ab {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:56:47 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227d1d9b-a300-4719-95cc-24941f61bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e963fea-02c9-46f0-b78d-b66647d61d16', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00815c0-d7ea-444a-9825-be9087cc0fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:47 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab 1073741824 Sep 25 13:56:47 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Volume volume-0e963fea-02c9-46f0-b78d-b66647d61d16 (0e963fea-02c9-46f0-b78d-b66647d61d16): created successfully Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00815c0-d7ea-444a-9825-be9087cc0fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Flow 'volume_create_manager' (cd5daab1-f428-492b-8417-d3e9818c2b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:56:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fc498bb0-ca00-4938-9d88-d6722d0faf24 tempest-TestServerVolumeAttachmentScenario-791085443 None] Created volume successfully. Sep 25 13:56:48 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab 1073741824" returned: 0 in 0.556s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:56:48 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab Sep 25 13:56:48 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:56:48 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab" returned: 0 in 0.303s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77a09f0-07dc-4450-8643-472b91595f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1969bd64-4379-446a-b494-45199ad6d9ab', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204ad586-6857-4a31-a32d-8d50a3eaac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:56:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Volume volume-1969bd64-4379-446a-b494-45199ad6d9ab (1969bd64-4379-446a-b494-45199ad6d9ab): created successfully Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204ad586-6857-4a31-a32d-8d50a3eaac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:56:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Flow 'volume_create_manager' (e10dbe1e-d97d-4214-b9ad-ac3f28dce368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:56:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-828b4ef9-d6d8-48c0-b2b3-bb6be0bdd7e0 tempest-TestServerVolumeAttachmentScenario-791085443 None] Created volume successfully. Sep 25 13:56:58 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:56:58 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=2,cinder:SELECT=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:57:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:10 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:57:10 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:10 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.397s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:57:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:57:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:57:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:57:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:57:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:57:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-44bd8710-89c1-4e55-87a7-f48186614d93 req-0880241b-4940-4a95-8aed-ed282a06aa63 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:57:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-44bd8710-89c1-4e55-87a7-f48186614d93 req-0880241b-4940-4a95-8aed-ed282a06aa63 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:57:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-44bd8710-89c1-4e55-87a7-f48186614d93 req-0880241b-4940-4a95-8aed-ed282a06aa63 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:57:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-44bd8710-89c1-4e55-87a7-f48186614d93 req-0880241b-4940-4a95-8aed-ed282a06aa63 tempest-TestServerVolumeAttachmentScenario-791085443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-0e963fea-02c9-46f0-b78d-b66647d61d16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81abbb62-d300-490b-b684-0a6eb0cb78d2', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:57:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-44bd8710-89c1-4e55-87a7-f48186614d93 req-0880241b-4940-4a95-8aed-ed282a06aa63 tempest-TestServerVolumeAttachmentScenario-791085443 None] attachment_update completed successfully. Sep 25 13:57:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-cae31855-4296-471a-9f79-20c63ce4bc2a req-46a6da88-e9e6-426b-8d63-31e9962e3b9d tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:57:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-cae31855-4296-471a-9f79-20c63ce4bc2a req-46a6da88-e9e6-426b-8d63-31e9962e3b9d tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:57:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-cae31855-4296-471a-9f79-20c63ce4bc2a req-46a6da88-e9e6-426b-8d63-31e9962e3b9d tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:57:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-cae31855-4296-471a-9f79-20c63ce4bc2a req-46a6da88-e9e6-426b-8d63-31e9962e3b9d tempest-TestServerVolumeAttachmentScenario-791085443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-1969bd64-4379-446a-b494-45199ad6d9ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a19340c9-d30a-422d-948d-f879c1c49f94', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:57:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-cae31855-4296-471a-9f79-20c63ce4bc2a req-46a6da88-e9e6-426b-8d63-31e9962e3b9d tempest-TestServerVolumeAttachmentScenario-791085443 None] attachment_update completed successfully. Sep 25 13:57:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-b517bee7-1194-4338-8fd3-7c13f7b969a6 req-e0b95833-d185-4a27-88df-fb42a005b443 tempest-TestServerVolumeAttachmentScenario-791085443 None] Terminate volume connection completed successfully. Sep 25 13:57:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-b517bee7-1194-4338-8fd3-7c13f7b969a6 req-e0b95833-d185-4a27-88df-fb42a005b443 tempest-TestServerVolumeAttachmentScenario-791085443 None] Deleting attachment a19340c9-d30a-422d-948d-f879c1c49f94. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:57:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-a16c7cc5-9ac8-4e98-a121-6145c5d56339 req-b5954982-b828-4136-945d-70c0b0f87141 tempest-TestServerVolumeAttachmentScenario-791085443 None] Terminate volume connection completed successfully. Sep 25 13:57:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-a16c7cc5-9ac8-4e98-a121-6145c5d56339 req-b5954982-b828-4136-945d-70c0b0f87141 tempest-TestServerVolumeAttachmentScenario-791085443 None] Deleting attachment 81abbb62-d300-490b-b684-0a6eb0cb78d2. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "cinder-1969bd64-4379-446a-b494-45199ad6d9ab-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-1969bd64-4379-446a-b494-45199ad6d9ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "cinder-quobyte-1969bd64-4379-446a-b494-45199ad6d9ab" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-quobyte-1969bd64-4379-446a-b494-45199ad6d9ab" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b614d-a567-432a-a9ac-350f04d48e29]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:34 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab Sep 25 13:57:34 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:34 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab" returned: 0 in 0.399s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:34 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab Sep 25 13:57:34 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:34 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1969bd64-4379-446a-b494-45199ad6d9ab" returned: 0 in 0.313s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-quobyte-1969bd64-4379-446a-b494-45199ad6d9ab" released by "delete_volume" :: held 0.767s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Created reservations ['55d23876-6537-4af5-806b-9dc7420cd47d', '82f03513-9e90-4d68-a8a2-608e0b62abb4', 'ac93deca-1adb-4410-8644-fcaee78ace2e', 'cb09cb4c-d3a9-4a27-bad7-0be6eca64e8d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:35 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:57:35 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "cinder-0e963fea-02c9-46f0-b78d-b66647d61d16-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-0e963fea-02c9-46f0-b78d-b66647d61d16-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "cinder-quobyte-0e963fea-02c9-46f0-b78d-b66647d61d16" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:57:35 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.294s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-quobyte-0e963fea-02c9-46f0-b78d-b66647d61d16" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:57:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Deleted volume successfully. Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7d0b34-0799-40a3-a8d1-e12c7afb88f3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f0fc1ade-36d5-48a3-ae5c-b9dc9f1de501 tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-1969bd64-4379-446a-b494-45199ad6d9ab-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:57:35 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 Sep 25 13:57:35 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:35 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16" returned: 0 in 0.441s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:35 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16 Sep 25 13:57:35 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:36 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0e963fea-02c9-46f0-b78d-b66647d61d16" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-quobyte-0e963fea-02c9-46f0-b78d-b66647d61d16" released by "delete_volume" :: held 0.814s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Created reservations ['5df83d76-c396-40a0-bbe0-1ee73303d816', '7352c908-0bf7-4c00-99a6-0abf6a8a3c37', '70b6739f-2e23-4106-a5f8-a70c328788bf', '2b481e09-90d8-4cbf-a5e5-56f03e926e09'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:57:36 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:57:36 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:57:36 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.273s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:57:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Deleted volume successfully. Sep 25 13:57:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-90a56bee-c254-4188-ae37-c7924cf7c78f tempest-TestServerVolumeAttachmentScenario-791085443 None] Lock "cinder-0e963fea-02c9-46f0-b78d-b66647d61d16-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:57:46 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=25,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:57:46 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:58:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:10 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:58:10 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:10 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.340s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:58:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:58:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:58:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Flow 'volume_create_manager' (ddfd0217-9f4d-417b-a558-6cc5046ed583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dd44da-3877-4a9b-94e9-6b4f59a3f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dd44da-3877-4a9b-94e9-6b4f59a3f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1570008273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac38975-b144-4835-8f7b-7e926e161a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c068cb0f84a4bf0a96ec9f2d2068be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:58:16Z,use_quota=True,user_id='6e89d3bf885b47ff9043860e48cc2cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65880e02-affd-4cc1-b46f-a311804ed09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65880e02-affd-4cc1-b46f-a311804ed09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d326ddda-32a4-4be2-a094-d45b357a0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:58:15 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d326ddda-32a4-4be2-a094-d45b357a0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fac38975-b144-4835-8f7b-7e926e161a4d', 'volume_name': 'volume-fac38975-b144-4835-8f7b-7e926e161a4d', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251709c4-4c75-4a13-96b8-3190a3417c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251709c4-4c75-4a13-96b8-3190a3417c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038b03c4-bc5f-4b79-91ac-3b5d1a4295e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:58:16 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Volume fac38975-b144-4835-8f7b-7e926e161a4d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fac38975-b144-4835-8f7b-7e926e161a4d', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Trying to clone fac38975-b144-4835-8f7b-7e926e161a4d from image a1a28988-676d-4ae6-a228-f7c326723a56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:58:16 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Image download 20.69 MB at 20.69 MB/s Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc0aef-32c3-41aa-9e5e-3bdddf33626a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:58:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:17 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD Sep 25 13:58:17 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:17 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 is fetched for user 6e89d3bf885b47ff9043860e48cc2cad. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe9c7c-9d3b-4ad9-a37b-a19fadae643a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:17 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD Sep 25 13:58:17 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:17 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1570008273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac38975-b144-4835-8f7b-7e926e161a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c068cb0f84a4bf0a96ec9f2d2068be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:58:16Z,use_quota=True,user_id='6e89d3bf885b47ff9043860e48cc2cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Creating volume fac38975-b144-4835-8f7b-7e926e161a4d {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:58:17 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 13:58:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:17 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d 1073741824 Sep 25 13:58:17 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:18 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d 1073741824" returned: 0 in 0.486s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:18 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d Sep 25 13:58:18 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:18 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Attempting download of a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume fac38975-b144-4835-8f7b-7e926e161a4d. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc825b20-6614-47f0-a4ed-72e371ed1dab]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:58:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:18 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo Sep 25 13:58:18 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:19 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo" returned: 0 in 0.382s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:19 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo Sep 25 13:58:19 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:19 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo" returned: 1 in 0.359s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1a28988-676d-4ae6-a228-f7c326723a56_hrz5iolo' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14e9b6-ab94-4438-8fb6-ab37e69f20d1]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:19 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD Sep 25 13:58:19 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:19 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] a1a28988-676d-4ae6-a228-f7c326723a56 was qcow2, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:58:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:19 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d Sep 25 13:58:19 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:21 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d" returned: 0 in 2.095s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:21 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1a28988-676d-4ae6-a228-f7c326723a56_nhxahok2devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:58:21 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Converted 112.00 MB image at 53.43 MB/s Sep 25 13:58:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:58:21 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d 1G Sep 25 13:58:21 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:58:22 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d 1G" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Downloaded image a1a28988-676d-4ae6-a228-f7c326723a56 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}])) to volume fac38975-b144-4835-8f7b-7e926e161a4d successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Temporary image a1a28988-676d-4ae6-a228-f7c326723a56 for user 6e89d3bf885b47ff9043860e48cc2cad is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Marking volume fac38975-b144-4835-8f7b-7e926e161a4d as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Copying metadata from image a1a28988-676d-4ae6-a228-f7c326723a56 to fac38975-b144-4835-8f7b-7e926e161a4d. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Creating volume glance metadata for volume fac38975-b144-4835-8f7b-7e926e161a4d backed by image a1a28988-676d-4ae6-a228-f7c326723a56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038b03c4-bc5f-4b79-91ac-3b5d1a4295e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac38975-b144-4835-8f7b-7e926e161a4d', 'volume_size': 1, 'image_id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1a28988-676d-4ae6-a228-f7c326723a56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be0b104f10c1494284fca385115e44a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1a28988-676d-4ae6-a228-f7c326723a56', 'created_at': datetime.datetime(2026, 9, 25, 11, 29, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1a28988-676d-4ae6-a228-f7c326723a56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed07fef6-cf42-4a08-a467-16494e5195f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:58:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Volume volume-fac38975-b144-4835-8f7b-7e926e161a4d (fac38975-b144-4835-8f7b-7e926e161a4d): created successfully Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed07fef6-cf42-4a08-a467-16494e5195f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:58:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Flow 'volume_create_manager' (ddfd0217-9f4d-417b-a558-6cc5046ed583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:58:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2b7e350d-9116-49e6-8cc2-fcf9dc68ba2e tempest-TestShelveInstance-1747955764 None] Created volume successfully. Sep 25 13:58:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-e9439a17-1c27-4dd5-84f9-5c4960b9c017 req-b6aa2ecb-de6c-4612-a299-8f3474c2355d tempest-TestShelveInstance-1747955764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:58:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-e9439a17-1c27-4dd5-84f9-5c4960b9c017 req-b6aa2ecb-de6c-4612-a299-8f3474c2355d tempest-TestShelveInstance-1747955764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:58:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-e9439a17-1c27-4dd5-84f9-5c4960b9c017 req-b6aa2ecb-de6c-4612-a299-8f3474c2355d tempest-TestShelveInstance-1747955764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:58:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-e9439a17-1c27-4dd5-84f9-5c4960b9c017 req-b6aa2ecb-de6c-4612-a299-8f3474c2355d tempest-TestShelveInstance-1747955764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-fac38975-b144-4835-8f7b-7e926e161a4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3dcf23f-771f-4017-a04e-804585304994', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:58:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-e9439a17-1c27-4dd5-84f9-5c4960b9c017 req-b6aa2ecb-de6c-4612-a299-8f3474c2355d tempest-TestShelveInstance-1747955764 None] attachment_update completed successfully. Sep 25 13:58:36 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:58:36 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=10 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:59:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:59:10 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 13:59:10 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:59:10 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 25 13:59:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.292s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:59:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:59:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:59:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:59:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:59:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:59:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-72a74145-f5b7-49e6-94a4-7bc4378072d9 req-55b2ef87-2662-44b3-af54-4b57b9966adb tempest-TestShelveInstance-1747955764 None] Terminate volume connection completed successfully. Sep 25 13:59:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-72a74145-f5b7-49e6-94a4-7bc4378072d9 req-55b2ef87-2662-44b3-af54-4b57b9966adb tempest-TestShelveInstance-1747955764 None] Deleting attachment c3dcf23f-771f-4017-a04e-804585304994. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:59:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-76cbd621-c360-4c08-8543-a77563bc5ad5 req-f1e154be-a408-41ce-94d5-75e5c6619d28 tempest-TestShelveInstance-1747955764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:59:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-76cbd621-c360-4c08-8543-a77563bc5ad5 req-f1e154be-a408-41ce-94d5-75e5c6619d28 tempest-TestShelveInstance-1747955764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:59:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-76cbd621-c360-4c08-8543-a77563bc5ad5 req-f1e154be-a408-41ce-94d5-75e5c6619d28 tempest-TestShelveInstance-1747955764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:59:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-76cbd621-c360-4c08-8543-a77563bc5ad5 req-f1e154be-a408-41ce-94d5-75e5c6619d28 tempest-TestShelveInstance-1747955764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-fac38975-b144-4835-8f7b-7e926e161a4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03a3fa05-3176-425b-b9fd-d31065976730', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:59:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-76cbd621-c360-4c08-8543-a77563bc5ad5 req-f1e154be-a408-41ce-94d5-75e5c6619d28 tempest-TestShelveInstance-1747955764 None] attachment_update completed successfully. Sep 25 13:59:28 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:59:28 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:00:04 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bb6d2b2f-4845-4c59-b79a-4e4c84195745 tempest-TestShelveInstance-1747955764 None] Terminate volume connection completed successfully. Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bb6d2b2f-4845-4c59-b79a-4e4c84195745 tempest-TestShelveInstance-1747955764 None] Deleting attachment 03a3fa05-3176-425b-b9fd-d31065976730. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Acquiring lock "cinder-fac38975-b144-4835-8f7b-7e926e161a4d-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Lock "cinder-fac38975-b144-4835-8f7b-7e926e161a4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Acquiring lock "cinder-quobyte-fac38975-b144-4835-8f7b-7e926e161a4d" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Lock "cinder-quobyte-fac38975-b144-4835-8f7b-7e926e161a4d" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bf5986-31e2-45c8-aea6-dcc114e7d1a0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:00:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:00:04 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d Sep 25 14:00:04 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:00:05 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d" returned: 0 in 0.454s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:00:05 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d Sep 25 14:00:05 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:00:05 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fac38975-b144-4835-8f7b-7e926e161a4d" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Lock "cinder-quobyte-fac38975-b144-4835-8f7b-7e926e161a4d" released by "delete_volume" :: held 0.815s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG cinder.quota [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Created reservations ['5ae8fb35-ac37-4611-b07e-1d0acba7c766', '2fc88d42-85ff-49b3-be95-3d7afb05710e', 'ada06b50-546d-4e4b-90fb-1f559819bd01', '7e6cd398-01b5-4a37-ad0f-ba80f6ae4b11'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:00:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:00:05 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:00:05 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:00:06 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 25 14:00:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:00:06 devstack cinder-volume[87220]: DEBUG cinder.manager [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:00:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Deleted volume successfully. Sep 25 14:00:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [req-b60698bb-27e9-4a10-a6d0-5cff1cc142b3 req-bbc9a20d-4ac8-440b-9483-e73b00629a74 tempest-TestShelveInstance-1747955764 None] Lock "cinder-fac38975-b144-4835-8f7b-7e926e161a4d-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:00:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:00:10 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:00:10 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:00:10 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 25 14:00:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.314s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:00:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:00:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:00:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:00:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:00:15 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:00:16 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Flow 'volume_create_manager' (e2a6390f-ba34-49d1-b45b-20b8c71a6eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ae3401-3524-403d-aa08-19044c9d5d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ae3401-3524-403d-aa08-19044c9d5d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1989645538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4284de63bf314692b0311cb6bd0f0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:00:48Z,use_quota=True,user_id='4a5ff48352824c02a2bdc0aa0c1d6fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f3ebf0-d30e-4682-912b-3928c548604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f3ebf0-d30e-4682-912b-3928c548604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a575c0b-e7a1-4ba9-a787-3b2ca559a045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a575c0b-e7a1-4ba9-a787-3b2ca559a045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3', 'volume_name': 'volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59fabb7-d205-4b97-bbce-75727fcde0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59fabb7-d205-4b97-bbce-75727fcde0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bde018b-a917-41cf-b5ec-272199203f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:00:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Volume 2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3', 'volume_size': 1} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1989645538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4284de63bf314692b0311cb6bd0f0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:00:48Z,use_quota=True,user_id='4a5ff48352824c02a2bdc0aa0c1d6fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Creating volume 2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:00:47 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:00:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:00:47 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 1073741824 Sep 25 14:00:47 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:00:48 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 1073741824" returned: 0 in 0.511s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:00:48 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 Sep 25 14:00:48 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:00:48 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bde018b-a917-41cf-b5ec-272199203f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e28200-215d-4816-8bf3-68b313582ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:00:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Volume volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 (2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3): created successfully Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e28200-215d-4816-8bf3-68b313582ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:00:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Flow 'volume_create_manager' (e2a6390f-ba34-49d1-b45b-20b8c71a6eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:00:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fbd0f7d5-4531-4633-9f56-853a42ab7eed tempest-TestStampPattern-67469045 None] Created volume successfully. Sep 25 14:00:58 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:00:58 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:01:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:10 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:01:10 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:10 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:01:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:01:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:01:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:01:13 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:01:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-e9b2c690-7c83-43aa-b73f-b1c5024ddf8a req-d4fcd7a5-ee65-45de-a002-aae92ef16a9b tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:01:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-e9b2c690-7c83-43aa-b73f-b1c5024ddf8a req-d4fcd7a5-ee65-45de-a002-aae92ef16a9b tempest-TestStampPattern-67469045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:01:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-e9b2c690-7c83-43aa-b73f-b1c5024ddf8a req-d4fcd7a5-ee65-45de-a002-aae92ef16a9b tempest-TestStampPattern-67469045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:01:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-e9b2c690-7c83-43aa-b73f-b1c5024ddf8a req-d4fcd7a5-ee65-45de-a002-aae92ef16a9b tempest-TestStampPattern-67469045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a196fd1-dc97-435f-802e-493f24733f29', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 14:01:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-e9b2c690-7c83-43aa-b73f-b1c5024ddf8a req-d4fcd7a5-ee65-45de-a002-aae92ef16a9b tempest-TestStampPattern-67469045 None] attachment_update completed successfully. Sep 25 14:01:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-d5aae75c-ea9e-40a3-a229-2f662da2fea8 req-b6781e3f-5225-4d0c-9e68-342481206605 tempest-TestStampPattern-67469045 None] Terminate volume connection completed successfully. Sep 25 14:01:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-d5aae75c-ea9e-40a3-a229-2f662da2fea8 req-b6781e3f-5225-4d0c-9e68-342481206605 tempest-TestStampPattern-67469045 None] Deleting attachment 9a196fd1-dc97-435f-802e-493f24733f29. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 14:01:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:01:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:01:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Creating offline snapshot cc075fd5-54a7-4df3-85d9-ced136f8b9ee of volume 2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:01:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b66126-94c1-40a6-bd9f-21babbbc0f2b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:01:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:27 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 Sep 25 14:01:27 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:27 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" returned: 0 in 0.394s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:27 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee 1G Sep 25 14:01:27 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:27 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee 1G" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:27 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee Sep 25 14:01:27 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:28 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee" returned: 0 in 0.339s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:28 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee is being set with open permissions: ugo+rw Sep 25 14:01:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:28 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee Sep 25 14:01:28 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:28 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee" returned: 0 in 0.281s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:28 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info Sep 25 14:01:28 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:28 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info" returned: 0 in 0.281s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:28 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info is being set with open permissions: ugo+rw Sep 25 14:01:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:28 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info Sep 25 14:01:28 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:29 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.info" returned: 0 in 0.334s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:01:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f044012c-6406-4772-b7c4-aac3d7e40d16 tempest-TestStampPattern-67469045 None] Create snapshot completed successfully Sep 25 14:01:36 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Flow 'volume_create_manager' (d9e50eff-5fc2-48e3-8eb5-2913d191c424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b4a45-b73e-4478-a8c5-8e831683c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b4a45-b73e-4478-a8c5-8e831683c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1725571214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a6a6a6-a988-42f4-a33c-c16209c6766f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4284de63bf314692b0311cb6bd0f0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc075fd5-54a7-4df3-85d9-ced136f8b9ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:01:37Z,use_quota=True,user_id='4a5ff48352824c02a2bdc0aa0c1d6fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db86297a-0301-4d95-8192-a350c1adffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db86297a-0301-4d95-8192-a350c1adffd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f9511b-ff32-4bce-9884-a7445a4e36f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f9511b-ff32-4bce-9884-a7445a4e36f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3a6a6a6-a988-42f4-a33c-c16209c6766f', 'volume_name': 'volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f', 'volume_size': 1, 'snapshot_id': 'cc075fd5-54a7-4df3-85d9-ced136f8b9ee'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1927f0-19e9-496b-bc51-70e02b13e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1927f0-19e9-496b-bc51-70e02b13e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25fbcd3-b306-409e-b6ae-1e6a90fd573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:01:37 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Volume d3a6a6a6-a988-42f4-a33c-c16209c6766f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f', 'volume_size': 1, 'snapshot_id': 'cc075fd5-54a7-4df3-85d9-ced136f8b9ee'} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-quobyte-cc075fd5-54a7-4df3-85d9-ced136f8b9ee-d3a6a6a6-a988-42f4-a33c-c16209c6766f" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-cc075fd5-54a7-4df3-85d9-ced136f8b9ee-d3a6a6a6-a988-42f4-a33c-c16209c6766f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Creating volume d3a6a6a6-a988-42f4-a33c-c16209c6766f from snapshot cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-quobyte-d3a6a6a6-a988-42f4-a33c-c16209c6766f" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-d3a6a6a6-a988-42f4-a33c-c16209c6766f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] snapshot: cc075fd5-54a7-4df3-85d9-ced136f8b9ee, volume: d3a6a6a6-a988-42f4-a33c-c16209c6766f, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea30df-f4aa-464b-95c2-7b7fd2d70bc3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:37 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee Sep 25 14:01:37 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:37 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee" returned: 0 in 0.464s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d6322-1480-4dc0-b5e6-e6e9779cdb7f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:01:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:37 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 Sep 25 14:01:37 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:38 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" returned: 0 in 0.468s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 14:01:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 14:01:38 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 14:01:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:38 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f Sep 25 14:01:38 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f" returned: 0 in 8.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:46 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3, size 1024.00 MB, duration 8.37 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:01:46 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Converted 1024.00 MB image at 122.27 MB/s Sep 25 14:01:46 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f is being set with open permissions: ugo+rw Sep 25 14:01:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:01:46 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f Sep 25 14:01:46 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:01:46 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 25 14:01:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f" returned: 0 in 0.438s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:01:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-d3a6a6a6-a988-42f4-a33c-c16209c6766f" released by "_copy_volume_from_snapshot" :: held 9.839s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:01:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-cc075fd5-54a7-4df3-85d9-ced136f8b9ee-d3a6a6a6-a988-42f4-a33c-c16209c6766f" released by "_create_volume_from_snapshot" :: held 9.922s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:01:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.941s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:01:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25fbcd3-b306-409e-b6ae-1e6a90fd573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f', 'volume_size': 1, 'snapshot_id': 'cc075fd5-54a7-4df3-85d9-ced136f8b9ee'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:01:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48b8ee4-2662-426a-ba56-66a45f7a4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:01:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Volume volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f (d3a6a6a6-a988-42f4-a33c-c16209c6766f): created successfully Sep 25 14:01:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48b8ee4-2662-426a-ba56-66a45f7a4403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:01:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Flow 'volume_create_manager' (d9e50eff-5fc2-48e3-8eb5-2913d191c424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:01:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-53fba9d8-d5ca-4e1e-b535-4376914ba5f5 tempest-TestStampPattern-67469045 None] Created volume successfully. Sep 25 14:01:57 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:01:57 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:02:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:10 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:02:10 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:10 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.258s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:02:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:02:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:02:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:02:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-84d1c666-96a2-4410-a911-b5b6cb4280cb req-b3c5e1c2-1de9-448c-9845-c92cab1ab2ad tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:02:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-84d1c666-96a2-4410-a911-b5b6cb4280cb req-b3c5e1c2-1de9-448c-9845-c92cab1ab2ad tempest-TestStampPattern-67469045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:02:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [req-84d1c666-96a2-4410-a911-b5b6cb4280cb req-b3c5e1c2-1de9-448c-9845-c92cab1ab2ad tempest-TestStampPattern-67469045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:02:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-84d1c666-96a2-4410-a911-b5b6cb4280cb req-b3c5e1c2-1de9-448c-9845-c92cab1ab2ad tempest-TestStampPattern-67469045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60', 'name': 'volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f18db9aa-66dc-4b50-bdec-3be302644dee', 'enforce_multipath': True} {{(pid=87220) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 14:02:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-84d1c666-96a2-4410-a911-b5b6cb4280cb req-b3c5e1c2-1de9-448c-9845-c92cab1ab2ad tempest-TestStampPattern-67469045 None] attachment_update completed successfully. Sep 25 14:02:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [req-c917f163-8968-4bff-a5f8-0c693e73f18f req-f487203a-6a1c-4221-968c-ea54a702bfc7 tempest-TestStampPattern-67469045 None] Terminate volume connection completed successfully. Sep 25 14:02:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [req-c917f163-8968-4bff-a5f8-0c693e73f18f req-f487203a-6a1c-4221-968c-ea54a702bfc7 tempest-TestStampPattern-67469045 None] Deleting attachment f18db9aa-66dc-4b50-bdec-3be302644dee. {{(pid=87220) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-d3a6a6a6-a988-42f4-a33c-c16209c6766f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Lock "cinder-d3a6a6a6-a988-42f4-a33c-c16209c6766f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-quobyte-d3a6a6a6-a988-42f4-a33c-c16209c6766f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-d3a6a6a6-a988-42f4-a33c-c16209c6766f" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f80829-84e7-4367-b161-5e3ce2ff0122]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:37 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f Sep 25 14:02:37 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:37 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f" returned: 0 in 0.401s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:37 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f Sep 25 14:02:37 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:38 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d3a6a6a6-a988-42f4-a33c-c16209c6766f" returned: 0 in 0.275s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-d3a6a6a6-a988-42f4-a33c-c16209c6766f" released by "delete_volume" :: held 0.724s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Created reservations ['b1d3a458-c5d1-4b93-900f-13f1066da614', '0905a2f0-3a76-4965-9c3a-d50fe87e7248', '467a6794-78b4-482c-981d-c27dcb457738', '61c3fc41-60c7-414f-8dda-d339a6a7e3b1'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:38 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:02:38 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:38 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.269s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:02:38 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Deleted volume successfully. Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e5f2b8fb-bc52-4ca2-addd-5fb4d220dbc8 tempest-TestStampPattern-67469045 None] Lock "cinder-d3a6a6a6-a988-42f4-a33c-c16209c6766f-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-cc075fd5-54a7-4df3-85d9-ced136f8b9ee-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Lock "cinder-cc075fd5-54a7-4df3-85d9-ced136f8b9ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-quobyte-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-quobyte-cc075fd5-54a7-4df3-85d9-ced136f8b9ee" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-cc075fd5-54a7-4df3-85d9-ced136f8b9ee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Deleting offline snapshot cc075fd5-54a7-4df3-85d9-ced136f8b9ee of volume 2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] snapshot_file for this snap is: volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[04addf47-85be-46b1-818a-6954f931d4fa]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:02:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:38 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee Sep 25 14:02:38 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:39 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee" returned: 0 in 0.378s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:02:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f77258-385d-48ef-b6db-fb9c55bb6c79]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:02:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:39 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 Sep 25 14:02:39 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:39 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" returned: 0 in 0.504s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:39 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee Sep 25 14:02:39 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:40 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee" returned: 0 in 0.360s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:40 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee Sep 25 14:02:40 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:40 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3.cc075fd5-54a7-4df3-85d9-ced136f8b9ee" returned: 0 in 0.274s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-cc075fd5-54a7-4df3-85d9-ced136f8b9ee" released by "_delete_snapshot" :: held 1.631s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" released by "delete_snapshot" :: held 1.653s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Created reservations ['7c3f1d84-ac95-4f61-b7f5-1f505a4f2b4e', '827f2a33-8e1f-4b26-857c-6eee9f74b6a1', 'f82984b0-6f77-4bcb-87f8-d369117283eb', '0abe6599-d596-4fa1-afad-9e0152ac91dd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:02:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Delete snapshot completed successfully. Sep 25 14:02:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d6989135-ed20-4cca-b305-24f7fe2bed45 tempest-TestStampPattern-67469045 None] Lock "cinder-cc075fd5-54a7-4df3-85d9-ced136f8b9ee-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Lock "cinder-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Acquiring lock "cinder-quobyte-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:02:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:02:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f927abb-6b51-4111-aad0-3a1954d22966]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:02:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:44 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 Sep 25 14:02:44 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:44 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" returned: 0 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:45 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3 Sep 25 14:02:45 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:45 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" returned: 0 in 0.251s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Lock "cinder-quobyte-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3" released by "delete_volume" :: held 0.741s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Created reservations ['4cbd239d-8b63-4a68-925b-396687dcf15d', '39d0efd9-1579-4849-badc-a2744975ac8c', '7d9b5375-ab52-4cd3-992b-e3e44a3c4c37', '50e8869b-b4bc-4485-988b-f8d63ed5347f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:02:45 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:02:45 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:02:45 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.248s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:02:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Deleted volume successfully. Sep 25 14:02:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-643f5c18-0315-46b4-b3ea-7d356f421e17 tempest-TestStampPattern-67469045 None] Lock "cinder-2532644b-f6c0-45ce-87c9-5f0ff6b3c5c3-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:02:55 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:02:55 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Flow 'volume_create_manager' (944b60c3-01a2-40f4-8ab3-80b543c81399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d1f430-61ca-4721-b7b0-50a80ab57ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d1f430-61ca-4721-b7b0-50a80ab57ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528fb027-c017-4102-8be2-58414a12ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6be013e05dd463692ed6d4d9de7fd70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:02Z,use_quota=True,user_id='c870d53195e44dc6a2bbce4bae2e028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f321b5-cc4b-4c7b-b10b-b72a70213156),volume_type_id=c8f321b5-cc4b-4c7b-b10b-b72a70213156)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2772498d-c9cc-482e-959b-74b8be7d44cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2772498d-c9cc-482e-959b-74b8be7d44cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a5711d-16f6-4b94-920a-e10d4bcb0b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a5711d-16f6-4b94-920a-e10d4bcb0b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '528fb027-c017-4102-8be2-58414a12ebbd', 'volume_name': 'volume-528fb027-c017-4102-8be2-58414a12ebbd', 'volume_size': 1, 'image_id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91770eabdbdf8ca5e779901c5651e759', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6be013e05dd463692ed6d4d9de7fd70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '136f5ba8531fc95e4deaeb6d9242eb2f854f82377f1a6dc7bfc9377872e6c978be1ba458948c6c8dc49b287271fdbc9ee6d87eea7451e3adbb29f12c575ac2f1', 'id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'created_at': datetime.datetime(2026, 9, 25, 12, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d5dd25-a1e0-4777-a739-9bf72d344979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d5dd25-a1e0-4777-a739-9bf72d344979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6d5cc4-c070-4287-8ae6-00e6914ed4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Volume 528fb027-c017-4102-8be2-58414a12ebbd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-528fb027-c017-4102-8be2-58414a12ebbd', 'volume_size': 1, 'image_id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91770eabdbdf8ca5e779901c5651e759', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6be013e05dd463692ed6d4d9de7fd70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '136f5ba8531fc95e4deaeb6d9242eb2f854f82377f1a6dc7bfc9377872e6c978be1ba458948c6c8dc49b287271fdbc9ee6d87eea7451e3adbb29f12c575ac2f1', 'id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'created_at': datetime.datetime(2026, 9, 25, 12, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Trying to clone 528fb027-c017-4102-8be2-58414a12ebbd from image d32cecc3-15c0-4f6f-8753-25de24c4dfee at location (None, [{'url': 'file:///opt/stack/data/glance/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 14:03:02 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Image download 0.00 MB at 0.00 MB/s Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e7162-acdb-4495-aaa7-63245309a67d]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:02 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD Sep 25 14:03:02 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:02 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:02 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD Sep 25 14:03:02 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:03 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Temporary image d32cecc3-15c0-4f6f-8753-25de24c4dfee is fetched for user c870d53195e44dc6a2bbce4bae2e028a. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3963267-0e2b-4f01-8102-190a6060c82d]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:03 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD Sep 25 14:03:03 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:03 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:03 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD Sep 25 14:03:03 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:03 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528fb027-c017-4102-8be2-58414a12ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6be013e05dd463692ed6d4d9de7fd70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:02Z,use_quota=True,user_id='c870d53195e44dc6a2bbce4bae2e028a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f321b5-cc4b-4c7b-b10b-b72a70213156),volume_type_id=c8f321b5-cc4b-4c7b-b10b-b72a70213156)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Creating volume 528fb027-c017-4102-8be2-58414a12ebbd {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:03 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:03 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd 1073741824 Sep 25 14:03:03 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:04 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd 1073741824" returned: 0 in 0.462s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:04 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd Sep 25 14:03:04 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:04 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd" returned: 0 in 0.258s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Attempting download of d32cecc3-15c0-4f6f-8753-25de24c4dfee ((None, [{'url': 'file:///opt/stack/data/glance/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee', 'metadata': {}}])) to volume 528fb027-c017-4102-8be2-58414a12ebbd. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ac565-7ec5-4226-a881-90a984fea76d]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:04 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj Sep 25 14:03:04 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:05 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj" returned: 0 in 0.329s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:05 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj Sep 25 14:03:05 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:05 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj" returned: 1 in 0.347s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32cecc3-15c0-4f6f-8753-25de24c4dfee_xmor2erj' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c65d1-c1f2-4f73-a46d-e8eabda3ab05]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:05 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD Sep 25 14:03:05 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:05 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:05 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD Sep 25 14:03:05 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:06 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] d32cecc3-15c0-4f6f-8753-25de24c4dfee was raw, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:06 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd Sep 25 14:03:06 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:06 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd" returned: 0 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d32cecc3-15c0-4f6f-8753-25de24c4dfee_d4augkgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:03:06 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:06 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd 1G Sep 25 14:03:06 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:06 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd 1G" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Downloaded image d32cecc3-15c0-4f6f-8753-25de24c4dfee ((None, [{'url': 'file:///opt/stack/data/glance/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee', 'metadata': {}}])) to volume 528fb027-c017-4102-8be2-58414a12ebbd successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Temporary image d32cecc3-15c0-4f6f-8753-25de24c4dfee for user c870d53195e44dc6a2bbce4bae2e028a is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Marking volume 528fb027-c017-4102-8be2-58414a12ebbd as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Copying metadata from image d32cecc3-15c0-4f6f-8753-25de24c4dfee to 528fb027-c017-4102-8be2-58414a12ebbd. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Creating volume glance metadata for volume 528fb027-c017-4102-8be2-58414a12ebbd backed by image d32cecc3-15c0-4f6f-8753-25de24c4dfee with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '91770eabdbdf8ca5e779901c5651e759', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6d5cc4-c070-4287-8ae6-00e6914ed4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528fb027-c017-4102-8be2-58414a12ebbd', 'volume_size': 1, 'image_id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91770eabdbdf8ca5e779901c5651e759', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6be013e05dd463692ed6d4d9de7fd70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '136f5ba8531fc95e4deaeb6d9242eb2f854f82377f1a6dc7bfc9377872e6c978be1ba458948c6c8dc49b287271fdbc9ee6d87eea7451e3adbb29f12c575ac2f1', 'id': 'd32cecc3-15c0-4f6f-8753-25de24c4dfee', 'created_at': datetime.datetime(2026, 9, 25, 12, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d32cecc3-15c0-4f6f-8753-25de24c4dfee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523f8516-4e94-44d5-8a99-13bddd60acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:06 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Volume volume-528fb027-c017-4102-8be2-58414a12ebbd (528fb027-c017-4102-8be2-58414a12ebbd): created successfully Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523f8516-4e94-44d5-8a99-13bddd60acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:06 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Flow 'volume_create_manager' (944b60c3-01a2-40f4-8ab3-80b543c81399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8aaff0ec-dbdf-4522-a1e3-28faaec87d29 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Created volume successfully. Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Acquiring lock "cinder-528fb027-c017-4102-8be2-58414a12ebbd-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "cinder-528fb027-c017-4102-8be2-58414a12ebbd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Acquiring lock "cinder-quobyte-528fb027-c017-4102-8be2-58414a12ebbd" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "cinder-quobyte-528fb027-c017-4102-8be2-58414a12ebbd" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab389fa-7d82-4e06-a71f-709f1b8e187e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:07 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd Sep 25 14:03:07 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:07 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:07 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd Sep 25 14:03:07 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:08 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-528fb027-c017-4102-8be2-58414a12ebbd" returned: 0 in 0.258s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "cinder-quobyte-528fb027-c017-4102-8be2-58414a12ebbd" released by "delete_volume" :: held 0.668s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:08 devstack cinder-volume[87220]: WARNING cinder.quota [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 14:03:08 devstack cinder-volume[87220]: WARNING cinder.quota [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Created reservations ['a0532598-e3e7-45d3-b983-cb52293072f2', '34b1bda9-5109-46d7-9486-08880e989fef', '8e3f0cc9-b32a-4bf8-a726-d9455cfcc77d', 'b881f19b-a31c-4218-baf9-bb0400f398cc'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:08 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:08 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:08 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.313s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:08 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Deleted volume successfully. Sep 25 14:03:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-3817642a-4135-4076-93cf-20e6b0956aa9 tempest-VolumeAndVolumeTypeFromImageTest-2040401677 None] Lock "cinder-528fb027-c017-4102-8be2-58414a12ebbd-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:10 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:10 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:10 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:03:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:03:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (13541336-0e69-428b-886e-0d749e7a7e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074fe4e8-d384-418c-9026-e53db7f00eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074fe4e8-d384-418c-9026-e53db7f00eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1328891142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768ec3db-e29b-4d52-ae91-b853f216469a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:13Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d82e57-d65a-4146-a1b5-6b1fa2e6ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d82e57-d65a-4146-a1b5-6b1fa2e6ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee54473-fc49-4d3a-ac9c-0ca97777c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee54473-fc49-4d3a-ac9c-0ca97777c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768ec3db-e29b-4d52-ae91-b853f216469a', 'volume_name': 'volume-768ec3db-e29b-4d52-ae91-b853f216469a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776aa6c5-c082-4e66-b479-e3588728cb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776aa6c5-c082-4e66-b479-e3588728cb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfc351f-ee99-4da9-a410-478f64ba9620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Volume 768ec3db-e29b-4d52-ae91-b853f216469a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768ec3db-e29b-4d52-ae91-b853f216469a', 'volume_size': 1} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1328891142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768ec3db-e29b-4d52-ae91-b853f216469a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:13Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Creating volume 768ec3db-e29b-4d52-ae91-b853f216469a {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:13 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:13 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a 1073741824 Sep 25 14:03:13 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (632f9bea-d2d0-4484-a958-951922a705d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bd581f-1fca-4c77-bc01-0833131d7bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bd581f-1fca-4c77-bc01-0833131d7bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229151196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d2a8e3-b4ac-4a12-b892-d1b532c20635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:14Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aada9b64-367e-496d-b0b2-8117fbb649b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aada9b64-367e-496d-b0b2-8117fbb649b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0367337-ad1d-4c6e-b441-2fcb9bc81109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0367337-ad1d-4c6e-b441-2fcb9bc81109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d2a8e3-b4ac-4a12-b892-d1b532c20635', 'volume_name': 'volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f7d2ec-13fc-408f-a14c-1b06dfff3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f7d2ec-13fc-408f-a14c-1b06dfff3da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0732e23-d147-48a3-8f25-df3947dfda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:13 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Volume 65d2a8e3-b4ac-4a12-b892-d1b532c20635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635', 'volume_size': 1} Sep 25 14:03:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:14 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a 1073741824" returned: 0 in 0.617s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:14 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a Sep 25 14:03:14 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (30519947-7f86-4e74-9902-1b0331c29b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1c2984-3542-40a7-8ef0-7f585d283915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1c2984-3542-40a7-8ef0-7f585d283915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1202731100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f03d00-4ace-4c83-adbc-fec32e5e2c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:14Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a331d3-72ae-4ea9-8840-e98bdda33275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a331d3-72ae-4ea9-8840-e98bdda33275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dec4a3-5cc3-4ed2-8a9c-024a7601f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dec4a3-5cc3-4ed2-8a9c-024a7601f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f03d00-4ace-4c83-adbc-fec32e5e2c25', 'volume_name': 'volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effced0b-fcf7-4ec6-99a5-d6e2a79e7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effced0b-fcf7-4ec6-99a5-d6e2a79e7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35aaa7b-85a1-4237-a29d-6e3358437a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Volume 68f03d00-4ace-4c83-adbc-fec32e5e2c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25', 'volume_size': 1} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:14 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a" returned: 0 in 0.348s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229151196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d2a8e3-b4ac-4a12-b892-d1b532c20635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:14Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Creating volume 65d2a8e3-b4ac-4a12-b892-d1b532c20635 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:14 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfc351f-ee99-4da9-a410-478f64ba9620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768ec3db-e29b-4d52-ae91-b853f216469a', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b423d916-321c-4993-9260-fc22842e5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 1073741824 Sep 25 14:03:14 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Volume volume-768ec3db-e29b-4d52-ae91-b853f216469a (768ec3db-e29b-4d52-ae91-b853f216469a): created successfully Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b423d916-321c-4993-9260-fc22842e5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (13541336-0e69-428b-886e-0d749e7a7e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7e98039a-bc84-4a3f-b6b6-85b618d3be28 tempest-CreateVolumesFromImageTest-1197670679 None] Created volume successfully. Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (aae953b5-b91a-49fd-97d1-97df532d4087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33085a8e-3006-400c-a1a7-51c000af688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33085a8e-3006-400c-a1a7-51c000af688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920840029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac92b5a-63a8-40b4-8d42-e1f0c6802b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:15Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ff36d-9243-4b33-8a32-eb418561fdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ff36d-9243-4b33-8a32-eb418561fdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37fa40e-9837-4b27-a006-5f3d88739719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37fa40e-9837-4b27-a006-5f3d88739719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac92b5a-63a8-40b4-8d42-e1f0c6802b47', 'volume_name': 'volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b080f8-5e7d-4f82-8d8b-def001805666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b080f8-5e7d-4f82-8d8b-def001805666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d00b62-dc73-424e-8b55-b2f6cf69a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Volume 5ac92b5a-63a8-40b4-8d42-e1f0c6802b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47', 'volume_size': 1} Sep 25 14:03:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:15 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 1073741824" returned: 0 in 0.556s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:15 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 Sep 25 14:03:15 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (167781fd-96d0-4ae9-aada-0b805a5b34a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d0ce46-a1fb-4ce3-8594-e159d1680562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d0ce46-a1fb-4ce3-8594-e159d1680562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089254214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c736357d-d458-4f35-9c6e-c0a6fb357e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:15Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbdf7f6-251c-467d-8292-8903ef906100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbdf7f6-251c-467d-8292-8903ef906100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e62bed5-3a8b-4d83-aa12-2972e9abe2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e62bed5-3a8b-4d83-aa12-2972e9abe2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c736357d-d458-4f35-9c6e-c0a6fb357e3f', 'volume_name': 'volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423e24f8-7718-4687-9d2a-02b902807f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423e24f8-7718-4687-9d2a-02b902807f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a3fb73-89a4-4059-a036-2942a54b2b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:15 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Volume c736357d-d458-4f35-9c6e-c0a6fb357e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f', 'volume_size': 1} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635" returned: 0 in 0.287s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1202731100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f03d00-4ace-4c83-adbc-fec32e5e2c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:14Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Creating volume 68f03d00-4ace-4c83-adbc-fec32e5e2c25 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:15 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0732e23-d147-48a3-8f25-df3947dfda9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:15 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 1073741824 Sep 25 14:03:15 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d059da-ab87-4d03-a774-41fdb6dd9000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Volume volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 (65d2a8e3-b4ac-4a12-b892-d1b532c20635): created successfully Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d059da-ab87-4d03-a774-41fdb6dd9000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (632f9bea-d2d0-4484-a958-951922a705d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-062f4175-0296-4d4e-872d-2177befafc30 tempest-CreateVolumesFromImageTest-1197670679 None] Created volume successfully. Sep 25 14:03:15 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 1073741824" returned: 0 in 0.421s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:15 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 Sep 25 14:03:15 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:16 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25" returned: 0 in 0.288s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920840029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac92b5a-63a8-40b4-8d42-e1f0c6802b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:15Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Creating volume 5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:16 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35aaa7b-85a1-4237-a29d-6e3358437a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864b436b-7cf4-442f-b12e-948ae1099388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:16 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 1073741824 Sep 25 14:03:16 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:16 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Volume volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 (68f03d00-4ace-4c83-adbc-fec32e5e2c25): created successfully Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864b436b-7cf4-442f-b12e-948ae1099388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (30519947-7f86-4e74-9902-1b0331c29b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4c1586e4-d680-4612-86c2-09eed5a1749a tempest-CreateVolumesFromImageTest-1197670679 None] Created volume successfully. Sep 25 14:03:16 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 1073741824" returned: 0 in 0.477s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:16 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 Sep 25 14:03:16 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:16 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089254214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c736357d-d458-4f35-9c6e-c0a6fb357e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f7cd8cb0f94a22bc5a17792ddcfa74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:15Z,use_quota=True,user_id='207488d7f2564f008515ffaecb9d9d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Creating volume c736357d-d458-4f35-9c6e-c0a6fb357e3f {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:16 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d00b62-dc73-424e-8b55-b2f6cf69a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:16 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f 1073741824 Sep 25 14:03:16 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953b740b-d451-4e70-a7d1-9487197cc879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:16 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Volume volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 (5ac92b5a-63a8-40b4-8d42-e1f0c6802b47): created successfully Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953b740b-d451-4e70-a7d1-9487197cc879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:16 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (aae953b5-b91a-49fd-97d1-97df532d4087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-44954ee6-ae97-4748-8716-a11045b74130 tempest-CreateVolumesFromImageTest-1197670679 None] Created volume successfully. Sep 25 14:03:17 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f 1073741824" returned: 0 in 0.466s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:17 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f Sep 25 14:03:17 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:17 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a3fb73-89a4-4059-a036-2942a54b2b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3092cd8-268f-4009-905c-dc1830d40ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:17 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Volume volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f (c736357d-d458-4f35-9c6e-c0a6fb357e3f): created successfully Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3092cd8-268f-4009-905c-dc1830d40ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Flow 'volume_create_manager' (167781fd-96d0-4ae9-aada-0b805a5b34a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-41548c33-4c50-43f2-92d0-5043e7706d8a tempest-CreateVolumesFromImageTest-1197670679 None] Created volume successfully. Sep 25 14:03:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-c736357d-d458-4f35-9c6e-c0a6fb357e3f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-c736357d-d458-4f35-9c6e-c0a6fb357e3f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-quobyte-c736357d-d458-4f35-9c6e-c0a6fb357e3f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-c736357d-d458-4f35-9c6e-c0a6fb357e3f" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f4942-b2c1-4c97-bc14-fc3a7360d7c4]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:18 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f Sep 25 14:03:18 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:19 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:19 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f Sep 25 14:03:19 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:19 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c736357d-d458-4f35-9c6e-c0a6fb357e3f" returned: 0 in 0.252s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-c736357d-d458-4f35-9c6e-c0a6fb357e3f" released by "delete_volume" :: held 0.701s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Created reservations ['6a8711c2-4894-451a-89b8-3deee1042696', '4ce6524a-6258-4668-8cde-a1bf184292d8', '7c84eff4-eb9f-47d9-9992-c58f4fa899f7', '2fd665b6-6465-4075-abf7-041086190221'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:19 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:19 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:19 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Deleted volume successfully. Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f31e8ea5-0dcc-49e2-bdad-ab3993bfbd9d tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-c736357d-d458-4f35-9c6e-c0a6fb357e3f-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-quobyte-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e8502d-a298-4daa-8c59-15ac7053c0cc]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:20 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 Sep 25 14:03:20 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:20 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:20 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47 Sep 25 14:03:20 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:20 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47" returned: 0 in 0.270s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47" released by "delete_volume" :: held 0.717s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Created reservations ['7593c0f8-3759-4a2c-8290-66e4010d132a', '9f877b7c-8016-46d6-934e-7d0de08c958a', '39b9c8bd-3c2a-4861-b6be-0f3e47026664', 'e739ba38-6e07-4de3-b6c0-1d975d639fc0'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:20 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:20 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:21 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-68f03d00-4ace-4c83-adbc-fec32e5e2c25-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.302s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Deleted volume successfully. Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-68f03d00-4ace-4c83-adbc-fec32e5e2c25-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e12e50fb-3ccf-41f8-8236-7d366f3c3cee tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-5ac92b5a-63a8-40b4-8d42-e1f0c6802b47-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-quobyte-68f03d00-4ace-4c83-adbc-fec32e5e2c25" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-68f03d00-4ace-4c83-adbc-fec32e5e2c25" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7e8cb-5b05-4e71-a4ce-8bdccbcc84f8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:21 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 Sep 25 14:03:21 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:21 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25" returned: 0 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:21 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25 Sep 25 14:03:21 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:21 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-68f03d00-4ace-4c83-adbc-fec32e5e2c25" returned: 0 in 0.233s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-68f03d00-4ace-4c83-adbc-fec32e5e2c25" released by "delete_volume" :: held 0.686s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Created reservations ['dce6ed0f-bda0-4e9e-ba65-8582436ef734', '57055631-9d0a-46c4-b016-4049624e88d0', 'c8b12ee9-461b-4309-927f-85680a649109', 'fbe2f8fe-750b-4a71-a133-3a0b59dd43f0'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:22 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:22 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:22 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.294s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Deleted volume successfully. Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-65d2a8e3-b4ac-4a12-b892-d1b532c20635-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-678fa711-4f77-4238-a12a-596efb6270b2 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-68f03d00-4ace-4c83-adbc-fec32e5e2c25-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-65d2a8e3-b4ac-4a12-b892-d1b532c20635-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-quobyte-65d2a8e3-b4ac-4a12-b892-d1b532c20635" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-65d2a8e3-b4ac-4a12-b892-d1b532c20635" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b1052a-63cd-4a11-999f-a6b7546be41b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:22 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 Sep 25 14:03:22 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:22 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635" returned: 0 in 0.395s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:22 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635 Sep 25 14:03:22 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:23 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-65d2a8e3-b4ac-4a12-b892-d1b532c20635" returned: 0 in 0.251s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-65d2a8e3-b4ac-4a12-b892-d1b532c20635" released by "delete_volume" :: held 0.689s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Created reservations ['8f524c69-551f-4ff0-88e0-cb96ca487a2d', '7c6c874e-cdd0-4395-b175-142088fe5632', 'c4a6fbfb-ffcd-436d-b084-ddc583c327b7', 'cddf77ba-2914-4d24-a5ff-31cc5f1112d8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:23 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:23 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-768ec3db-e29b-4d52-ae91-b853f216469a-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:23 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.283s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-768ec3db-e29b-4d52-ae91-b853f216469a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Deleted volume successfully. Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fda393d-9c3f-484d-81fc-1ec06a233a48 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-65d2a8e3-b4ac-4a12-b892-d1b532c20635-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "cinder-quobyte-768ec3db-e29b-4d52-ae91-b853f216469a" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-768ec3db-e29b-4d52-ae91-b853f216469a" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[26380045-fcdb-483d-b4af-0f1619a954b0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:23 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a Sep 25 14:03:23 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:24 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a" returned: 0 in 0.395s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:24 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a Sep 25 14:03:24 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:24 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-768ec3db-e29b-4d52-ae91-b853f216469a" returned: 0 in 0.258s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-quobyte-768ec3db-e29b-4d52-ae91-b853f216469a" released by "delete_volume" :: held 0.696s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Created reservations ['be51cede-a274-411d-b865-70ee953e0bea', 'f52ee3c7-38f1-473b-834d-fa7264c26760', '30b38938-a3e0-49cb-8660-25228ecc27cc', '06a531ca-8ce2-4f38-b2cc-6a0f558f280b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:24 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:24 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:24 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Deleted volume successfully. Sep 25 14:03:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4972cd77-abdb-41b2-9d24-8c324a8ab466 tempest-CreateVolumesFromImageTest-1197670679 None] Lock "cinder-768ec3db-e29b-4d52-ae91-b853f216469a-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Flow 'volume_create_manager' (7e66f0a3-c0ae-4524-b948-de702f972e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f63a29-b9b4-4034-b3dc-a3502a531663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f63a29-b9b4-4034-b3dc-a3502a531663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-84344424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebca130-0bab-49a9-90d9-78dd81935abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976044deff8c40aba1409b377fcbaf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:28Z,use_quota=True,user_id='582d4f914f9c4d2ebd44b6a66e08a80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85914c73-0e1f-4aed-99e7-f54acf222d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85914c73-0e1f-4aed-99e7-f54acf222d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600d80a8-210a-4696-afb7-8f2e688362d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600d80a8-210a-4696-afb7-8f2e688362d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebca130-0bab-49a9-90d9-78dd81935abe', 'volume_name': 'volume-2ebca130-0bab-49a9-90d9-78dd81935abe', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad39ea-1c44-408f-a631-897279e8cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad39ea-1c44-408f-a631-897279e8cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5970d126-4e65-4c4a-8ffe-a9c6f95959e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Volume 2ebca130-0bab-49a9-90d9-78dd81935abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebca130-0bab-49a9-90d9-78dd81935abe', 'volume_size': 1} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-84344424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebca130-0bab-49a9-90d9-78dd81935abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976044deff8c40aba1409b377fcbaf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:28Z,use_quota=True,user_id='582d4f914f9c4d2ebd44b6a66e08a80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Creating volume 2ebca130-0bab-49a9-90d9-78dd81935abe {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:28 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:28 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe 1073741824 Sep 25 14:03:28 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:28 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe 1073741824" returned: 0 in 0.449s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:28 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe Sep 25 14:03:28 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:29 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe" returned: 0 in 0.305s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5970d126-4e65-4c4a-8ffe-a9c6f95959e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebca130-0bab-49a9-90d9-78dd81935abe', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4f383-56e2-4f16-a89d-5f22f61f9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Volume volume-2ebca130-0bab-49a9-90d9-78dd81935abe (2ebca130-0bab-49a9-90d9-78dd81935abe): created successfully Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4f383-56e2-4f16-a89d-5f22f61f9695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Flow 'volume_create_manager' (7e66f0a3-c0ae-4524-b948-de702f972e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3e0fa847-4c08-4da1-90c3-344e0ce4aba5 tempest-ProjectReaderTests-2004280134 None] Created volume successfully. Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Acquiring lock "cinder-2ebca130-0bab-49a9-90d9-78dd81935abe-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-2ebca130-0bab-49a9-90d9-78dd81935abe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Acquiring lock "cinder-quobyte-2ebca130-0bab-49a9-90d9-78dd81935abe" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-quobyte-2ebca130-0bab-49a9-90d9-78dd81935abe" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4a454-81ff-4164-9146-1c39336c0123]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:30 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe Sep 25 14:03:30 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:30 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe" returned: 0 in 0.429s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:30 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe Sep 25 14:03:30 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:31 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2ebca130-0bab-49a9-90d9-78dd81935abe" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-quobyte-2ebca130-0bab-49a9-90d9-78dd81935abe" released by "delete_volume" :: held 0.761s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Created reservations ['87830122-6755-44eb-b5be-948586112213', '7589821c-1ad0-4595-ab8c-0a47eebf90bc', '5134ec39-7b16-470d-8dc8-7f6f60718cdf', 'e9984f3f-52b1-4066-af69-cd398a394f10'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:31 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:31 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:31 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.288s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Deleted volume successfully. Sep 25 14:03:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0de41f0f-d23c-42ef-94bb-198956e1c69b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-2ebca130-0bab-49a9-90d9-78dd81935abe-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Flow 'volume_create_manager' (793903cc-5bc7-4ed5-b05a-5d4a44097e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86bd39a-b5e5-4605-939a-5ee261eecf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86bd39a-b5e5-4605-939a-5ee261eecf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823119462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976044deff8c40aba1409b377fcbaf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:32Z,use_quota=True,user_id='582d4f914f9c4d2ebd44b6a66e08a80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9838de1d-e481-4488-8a3f-0557898ba546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9838de1d-e481-4488-8a3f-0557898ba546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bad300-b49b-4320-8705-ef5fbad9b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bad300-b49b-4320-8705-ef5fbad9b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63', 'volume_name': 'volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060e996c-9ac6-466c-9c89-2d4d0b7a0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060e996c-9ac6-466c-9c89-2d4d0b7a0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1309fe-d467-49ef-b484-518ef0676c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Volume 7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63', 'volume_size': 1} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823119462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976044deff8c40aba1409b377fcbaf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:03:32Z,use_quota=True,user_id='582d4f914f9c4d2ebd44b6a66e08a80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Creating volume 7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:32 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:32 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 1073741824 Sep 25 14:03:32 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:32 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 1073741824" returned: 0 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:32 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 Sep 25 14:03:32 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:32 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63" returned: 0 in 0.249s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1309fe-d467-49ef-b484-518ef0676c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8d4c6f-d18a-423e-bd9c-e5190c269792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Volume volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 (7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63): created successfully Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8d4c6f-d18a-423e-bd9c-e5190c269792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Flow 'volume_create_manager' (793903cc-5bc7-4ed5-b05a-5d4a44097e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-53daeb75-eb8e-415e-bedd-29079e925ab2 tempest-ProjectReaderTests-2004280134 None] Created volume successfully. Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Acquiring lock "cinder-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Acquiring lock "cinder-quobyte-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-quobyte-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[46012a4d-2309-4ae5-97a7-04d69a3f711f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:33 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 Sep 25 14:03:33 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:33 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63" returned: 0 in 0.396s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:33 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63 Sep 25 14:03:33 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:33 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63" returned: 0 in 0.275s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:33 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-quobyte-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63" released by "delete_volume" :: held 0.714s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Created reservations ['d7d40bfa-75a5-4b74-a8fc-6d39c021a503', 'b1a4598e-6308-4245-9fac-3072a0115680', 'c9b06e80-1a12-4b9e-a8d3-a4804bb8e2af', '755b6f30-86ac-41ae-83bb-3d69cf0d3d00'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:34 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:03:34 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:03:34 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.329s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:03:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Deleted volume successfully. Sep 25 14:03:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-06cb43e4-b0b0-4411-9ad9-ba7ae9dcbb1b tempest-ProjectReaderTests-2004280134 None] Lock "cinder-7cb4ce63-b1e6-485c-a8d7-509ff2bc5b63-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:03:44 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=58,cinder:INSERT=25,cinder:UPDATE=94,cinder:DELETE=8 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:03:44 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=86,cinder:SELECT=67,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Flow 'volume_create_manager' (c0fdeb25-2ec2-41e8-a5cb-d6c4cfa1fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9376283-2643-48fe-a2fc-5e7ea01ce639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9376283-2643-48fe-a2fc-5e7ea01ce639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1082432772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64df43c5-3f86-4e11-af95-f2d6b240f829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8365c59a909849308b296465fa714ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:00Z,use_quota=True,user_id='acf20b1e72774291904ef9ef14d59bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c050fd5-b7bf-4a09-a7b5-2db2b605053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c050fd5-b7bf-4a09-a7b5-2db2b605053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3edb3b4-2121-412e-9190-e87cd7195c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3edb3b4-2121-412e-9190-e87cd7195c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64df43c5-3f86-4e11-af95-f2d6b240f829', 'volume_name': 'volume-64df43c5-3f86-4e11-af95-f2d6b240f829', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c8303f-367b-490f-aa76-4e3a01f47889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c8303f-367b-490f-aa76-4e3a01f47889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6856b306-d9af-4b99-a027-08e8c63c344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:03:59 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Volume 64df43c5-3f86-4e11-af95-f2d6b240f829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64df43c5-3f86-4e11-af95-f2d6b240f829', 'volume_size': 1} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1082432772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64df43c5-3f86-4e11-af95-f2d6b240f829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8365c59a909849308b296465fa714ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:00Z,use_quota=True,user_id='acf20b1e72774291904ef9ef14d59bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Creating volume 64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:03:59 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:03:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:03:59 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 1073741824 Sep 25 14:03:59 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:00 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 1073741824" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:00 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 Sep 25 14:04:00 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:00 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829" returned: 0 in 0.261s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6856b306-d9af-4b99-a027-08e8c63c344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64df43c5-3f86-4e11-af95-f2d6b240f829', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29dc3d4-7314-4c3a-9663-da4930ec4884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:00 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Volume volume-64df43c5-3f86-4e11-af95-f2d6b240f829 (64df43c5-3f86-4e11-af95-f2d6b240f829): created successfully Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29dc3d4-7314-4c3a-9663-da4930ec4884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Flow 'volume_create_manager' (c0fdeb25-2ec2-41e8-a5cb-d6c4cfa1fe20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:00 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b0bf8846-507d-4705-9dec-25df6c279734 tempest-SnapshotDependencyTests-397747964 None] Created volume successfully. Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Creating offline snapshot 0f38416a-9549-40b6-86b1-6bdf24f6813a of volume 64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab083f0-4b3f-4207-9a4b-d1322d4adfd2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:01 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 Sep 25 14:04:01 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:01 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829" returned: 0 in 0.382s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:01 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a 1G Sep 25 14:04:01 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:01 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a 1G" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64df43c5-3f86-4e11-af95-f2d6b240f829 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:01 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64df43c5-3f86-4e11-af95-f2d6b240f829 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a Sep 25 14:04:01 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:02 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64df43c5-3f86-4e11-af95-f2d6b240f829 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a" returned: 0 in 0.290s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:02 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a is being set with open permissions: ugo+rw Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:02 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a Sep 25 14:04:02 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:02 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a" returned: 0 in 0.238s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:02 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info Sep 25 14:04:02 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:02 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:02 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info is being set with open permissions: ugo+rw Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:02 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info Sep 25 14:04:02 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:02 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.info" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f7cbc0c6-1b9b-4fc3-87ab-1d4f00a15a2a tempest-SnapshotDependencyTests-397747964 None] Create snapshot completed successfully Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Flow 'volume_create_manager' (3f4e1972-3426-4ba6-8a31-cfe3c8e99963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30178f28-d956-47bd-83d2-02516c7a9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30178f28-d956-47bd-83d2-02516c7a9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a55da7-b5a5-4195-9858-19f400f381b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8365c59a909849308b296465fa714ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f38416a-9549-40b6-86b1-6bdf24f6813a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:04Z,use_quota=True,user_id='acf20b1e72774291904ef9ef14d59bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618b2d72-62a3-4af6-9011-695c25faccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618b2d72-62a3-4af6-9011-695c25faccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52241cf0-160c-4fb2-9121-9912f8ed969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52241cf0-160c-4fb2-9121-9912f8ed969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7a55da7-b5a5-4195-9858-19f400f381b2', 'volume_name': 'volume-c7a55da7-b5a5-4195-9858-19f400f381b2', 'volume_size': 1, 'snapshot_id': '0f38416a-9549-40b6-86b1-6bdf24f6813a'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de904f18-0a9a-431c-a0cb-6a346e2fa8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de904f18-0a9a-431c-a0cb-6a346e2fa8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a52d8e-3ad8-4c97-84da-5f76b0cd1c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Volume c7a55da7-b5a5-4195-9858-19f400f381b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7a55da7-b5a5-4195-9858-19f400f381b2', 'volume_size': 1, 'snapshot_id': '0f38416a-9549-40b6-86b1-6bdf24f6813a'} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-quobyte-0f38416a-9549-40b6-86b1-6bdf24f6813a-c7a55da7-b5a5-4195-9858-19f400f381b2" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-0f38416a-9549-40b6-86b1-6bdf24f6813a-c7a55da7-b5a5-4195-9858-19f400f381b2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Creating volume c7a55da7-b5a5-4195-9858-19f400f381b2 from snapshot 0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-quobyte-c7a55da7-b5a5-4195-9858-19f400f381b2" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-c7a55da7-b5a5-4195-9858-19f400f381b2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] snapshot: 0f38416a-9549-40b6-86b1-6bdf24f6813a, volume: c7a55da7-b5a5-4195-9858-19f400f381b2, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df515f-081d-419c-aaef-f9c66239634f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:04 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a Sep 25 14:04:04 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:04 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a" returned: 0 in 0.455s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64df43c5-3f86-4e11-af95-f2d6b240f829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd434b4-c890-4cff-a115-40639ea11bba]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:04 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 Sep 25 14:04:04 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:04 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829" returned: 0 in 0.395s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 14:04:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:04 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 Sep 25 14:04:04 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:04:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:10 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:10 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:10 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.439s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:04:10 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2" returned: 0 in 5.943s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:04:10 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Converted 1024.00 MB image at 172.26 MB/s Sep 25 14:04:10 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 is being set with open permissions: ugo+rw Sep 25 14:04:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:10 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 Sep 25 14:04:10 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:11 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-c7a55da7-b5a5-4195-9858-19f400f381b2" released by "_copy_volume_from_snapshot" :: held 7.208s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-0f38416a-9549-40b6-86b1-6bdf24f6813a-c7a55da7-b5a5-4195-9858-19f400f381b2" released by "_create_volume_from_snapshot" :: held 7.284s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.303s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a52d8e-3ad8-4c97-84da-5f76b0cd1c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a55da7-b5a5-4195-9858-19f400f381b2', 'volume_size': 1, 'snapshot_id': '0f38416a-9549-40b6-86b1-6bdf24f6813a'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d067d04d-10e4-403f-ad64-50ec6360f5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Volume volume-c7a55da7-b5a5-4195-9858-19f400f381b2 (c7a55da7-b5a5-4195-9858-19f400f381b2): created successfully Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d067d04d-10e4-403f-ad64-50ec6360f5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Flow 'volume_create_manager' (3f4e1972-3426-4ba6-8a31-cfe3c8e99963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:11 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ab82b03e-d3bd-4d2b-a483-78a20055f9a5 tempest-SnapshotDependencyTests-397747964 None] Created volume successfully. Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-0f38416a-9549-40b6-86b1-6bdf24f6813a-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-0f38416a-9549-40b6-86b1-6bdf24f6813a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-quobyte-64df43c5-3f86-4e11-af95-f2d6b240f829" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-64df43c5-3f86-4e11-af95-f2d6b240f829" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-quobyte-0f38416a-9549-40b6-86b1-6bdf24f6813a" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-0f38416a-9549-40b6-86b1-6bdf24f6813a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Deleting offline snapshot 0f38416a-9549-40b6-86b1-6bdf24f6813a of volume 64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] snapshot_file for this snap is: volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23f340d-cb49-44c9-a367-c4bb14584d10]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:11 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a Sep 25 14:04:11 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:12 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a" returned: 0 in 0.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64df43c5-3f86-4e11-af95-f2d6b240f829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:04:12 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e06e6e8-1977-470d-ab8c-4e3e238118cb]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:12 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 Sep 25 14:04:12 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:12 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829" returned: 0 in 0.539s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:12 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a Sep 25 14:04:12 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:13 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a" returned: 0 in 0.348s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:13 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a Sep 25 14:04:13 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:13 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829.0f38416a-9549-40b6-86b1-6bdf24f6813a" returned: 0 in 0.245s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-0f38416a-9549-40b6-86b1-6bdf24f6813a" released by "_delete_snapshot" :: held 1.612s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-64df43c5-3f86-4e11-af95-f2d6b240f829" released by "delete_snapshot" :: held 1.636s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Created reservations ['7f30c00b-4a1e-42af-9f14-eada81e7d404', '1b08886c-124b-45fc-b914-dedab535835a', '9d9a331d-aed7-4684-9604-dc8238831793', '20345575-90bd-410c-83ed-fc789b39baef'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Delete snapshot completed successfully. Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-790f6a6f-6a01-4afc-bed2-2a20e74fdf8d tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-0f38416a-9549-40b6-86b1-6bdf24f6813a-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-64df43c5-3f86-4e11-af95-f2d6b240f829-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-64df43c5-3f86-4e11-af95-f2d6b240f829-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-quobyte-64df43c5-3f86-4e11-af95-f2d6b240f829" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-64df43c5-3f86-4e11-af95-f2d6b240f829" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eba0a4f-72eb-4938-8c54-03b2188a0ff2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:14 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 Sep 25 14:04:14 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:14 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829" returned: 0 in 0.383s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:14 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829 Sep 25 14:04:14 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:14 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-64df43c5-3f86-4e11-af95-f2d6b240f829" returned: 0 in 0.241s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-64df43c5-3f86-4e11-af95-f2d6b240f829" released by "delete_volume" :: held 0.688s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Created reservations ['9f7e531d-d4b8-4978-9d78-48987e6288a2', '12bf4fa8-9f20-4432-9ab5-62a85f0913ab', 'ba62d9e8-8e41-4c55-821b-b490692abbc5', 'd6f9c8c9-2c9b-499c-bce2-ea188e705170'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:14 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:14 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:14 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.250s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Deleted volume successfully. Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-65ec9597-3115-4822-a9e9-612f177cd474 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-64df43c5-3f86-4e11-af95-f2d6b240f829-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:14 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-c7a55da7-b5a5-4195-9858-19f400f381b2-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-c7a55da7-b5a5-4195-9858-19f400f381b2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "cinder-quobyte-c7a55da7-b5a5-4195-9858-19f400f381b2" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-c7a55da7-b5a5-4195-9858-19f400f381b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ce0b5-2d91-4e26-84e9-12125c288733]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:15 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 Sep 25 14:04:15 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:15 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2" returned: 0 in 0.385s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:15 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2 Sep 25 14:04:15 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:15 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-c7a55da7-b5a5-4195-9858-19f400f381b2" returned: 0 in 0.237s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-quobyte-c7a55da7-b5a5-4195-9858-19f400f381b2" released by "delete_volume" :: held 0.665s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Created reservations ['d4b509f4-56ac-4bae-8df0-065bbd576a34', '08e966c9-21f3-4d9a-b8b4-951ed91be487', '7616bd2b-1524-4849-8c50-90f1147a2474', 'c73bc041-913f-4717-85b8-74941cb7b968'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:15 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:15 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:16 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.259s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:16 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Deleted volume successfully. Sep 25 14:04:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-92d60901-e26f-44ef-95ee-e1bf55f4e581 tempest-SnapshotDependencyTests-397747964 None] Lock "cinder-c7a55da7-b5a5-4195-9858-19f400f381b2-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:25 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:04:26 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (a900031f-b959-4120-9b72-0d3883c28e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d455b35-8fd7-4cf1-b2e8-893866a8f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d455b35-8fd7-4cf1-b2e8-893866a8f402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951019639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:39Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861d1a8b-447b-4994-aa8a-0f5298c67fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861d1a8b-447b-4994-aa8a-0f5298c67fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cb3af5-00e7-4751-a4fb-b422655ff680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cb3af5-00e7-4751-a4fb-b422655ff680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193', 'volume_name': 'volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406cfd5e-e987-4188-b6a5-32a148c02fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406cfd5e-e987-4188-b6a5-32a148c02fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5abda3-fa32-4ace-8325-4f75421fdba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Volume 1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193', 'volume_size': 1} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951019639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:39Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Creating volume 1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:39 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:39 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 1073741824 Sep 25 14:04:39 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (40f057ed-89eb-4a40-9279-2e786d4e55b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69af17-620d-4830-8f14-ae06aff30a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (868f3578-2f26-4097-ae89-f248e0506a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac16c14-0cf4-4f6f-9f9f-608171019870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69af17-620d-4830-8f14-ae06aff30a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24515220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2956fb4-7eab-4a95-9244-338da02638e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:39Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da7bcef-208d-4fc9-a0e5-c17d4699f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da7bcef-208d-4fc9-a0e5-c17d4699f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf03351-aab5-49e2-95d0-a0352c1a74b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf03351-aab5-49e2-95d0-a0352c1a74b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2956fb4-7eab-4a95-9244-338da02638e1', 'volume_name': 'volume-f2956fb4-7eab-4a95-9244-338da02638e1', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed20aba2-f22e-483a-86e0-f7c76e27d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed20aba2-f22e-483a-86e0-f7c76e27d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15360d24-077b-4a9b-9e14-2bd77ffc9dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Volume f2956fb4-7eab-4a95-9244-338da02638e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2956fb4-7eab-4a95-9244-338da02638e1', 'volume_size': 1} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac16c14-0cf4-4f6f-9f9f-608171019870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821159412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfc8987-cb17-4d10-9290-68ad2afa343e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:39Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da23459b-a727-4a44-8ec9-eab65db2aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da23459b-a727-4a44-8ec9-eab65db2aff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c3f3a2-4dfc-468a-8c22-7da388b379a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c3f3a2-4dfc-468a-8c22-7da388b379a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfc8987-cb17-4d10-9290-68ad2afa343e', 'volume_name': 'volume-fbfc8987-cb17-4d10-9290-68ad2afa343e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293121c4-a310-4e85-9cc7-5cf912b86b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293121c4-a310-4e85-9cc7-5cf912b86b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851bd0bd-9661-4fbf-aa04-8c04d1e90e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:39 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume fbfc8987-cb17-4d10-9290-68ad2afa343e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfc8987-cb17-4d10-9290-68ad2afa343e', 'volume_size': 1} Sep 25 14:04:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:40 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 1073741824" returned: 0 in 0.739s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:40 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 Sep 25 14:04:40 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (500a7d4a-1109-42da-80bf-39cda79efc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90420e45-1897-48ef-9352-a71fbad4e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90420e45-1897-48ef-9352-a71fbad4e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266183350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8395cf4d-c7b0-471a-867b-47ad5dc87ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:40Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303267ae-984b-40f8-aae6-0d8532309d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303267ae-984b-40f8-aae6-0d8532309d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd631cec-ccaa-4184-971e-1312cdf6c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd631cec-ccaa-4184-971e-1312cdf6c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8395cf4d-c7b0-471a-867b-47ad5dc87ed5', 'volume_name': 'volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f713b012-7f21-4bc8-aa54-4c00d404254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f713b012-7f21-4bc8-aa54-4c00d404254d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498efffd-057a-4d5c-a6a0-178b3a3a99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Volume 8395cf4d-c7b0-471a-867b-47ad5dc87ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5', 'volume_size': 1} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:40 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193" returned: 0 in 0.443s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24515220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2956fb4-7eab-4a95-9244-338da02638e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:39Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Creating volume f2956fb4-7eab-4a95-9244-338da02638e1 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:40 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:40 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 1073741824 Sep 25 14:04:40 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5abda3-fa32-4ace-8325-4f75421fdba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0261bb-6f22-4d00-9419-427876b69b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Volume volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 (1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193): created successfully Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0261bb-6f22-4d00-9419-427876b69b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (a900031f-b959-4120-9b72-0d3883c28e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-de311e91-06cd-4845-aea0-09570984b854 tempest-CreateVolumesFromImageTest-1457217307 None] Created volume successfully. Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (93123aab-9439-4a9c-92d4-40ad5b33602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2ca119-5556-4154-854a-8d5216286af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2ca119-5556-4154-854a-8d5216286af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-745337722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9d932b-608b-4533-b31b-074edd629a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:41Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3096436-0dd4-46c6-bbe4-147418cc61eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3096436-0dd4-46c6-bbe4-147418cc61eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c20587-7b07-4b97-8b48-2d56e5144373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c20587-7b07-4b97-8b48-2d56e5144373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9d932b-608b-4533-b31b-074edd629a52', 'volume_name': 'volume-fb9d932b-608b-4533-b31b-074edd629a52', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279623d5-7690-4714-9743-d00c0e1f2c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279623d5-7690-4714-9743-d00c0e1f2c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1ec0af-ed7b-4d84-b833-39ec0c4eaa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Volume fb9d932b-608b-4533-b31b-074edd629a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9d932b-608b-4533-b31b-074edd629a52', 'volume_size': 1} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:41 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 1073741824" returned: 0 in 0.826s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:41 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 Sep 25 14:04:41 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (24d8591f-d5de-4a1c-ae81-f00bd386ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48900023-336e-4b4f-aecc-86b3ff179486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48900023-336e-4b4f-aecc-86b3ff179486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2025617138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:41Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bd2171-f6a1-4846-8909-c390e92c440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bd2171-f6a1-4846-8909-c390e92c440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543ec252-5fea-4239-8c81-3c8f4902afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543ec252-5fea-4239-8c81-3c8f4902afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68', 'volume_name': 'volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef66a3-4803-4200-827f-281995adf44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef66a3-4803-4200-827f-281995adf44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a27778-3f24-4648-8861-9c494e0a1c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Volume 1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68', 'volume_size': 1} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:41 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1" returned: 0 in 0.328s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821159412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfc8987-cb17-4d10-9290-68ad2afa343e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:39Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Creating volume fbfc8987-cb17-4d10-9290-68ad2afa343e {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:41 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:41 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e 1073741824 Sep 25 14:04:41 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15360d24-077b-4a9b-9e14-2bd77ffc9dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2956fb4-7eab-4a95-9244-338da02638e1', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091870f8-c010-4ebb-aa4e-6ab7535dab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Volume volume-f2956fb4-7eab-4a95-9244-338da02638e1 (f2956fb4-7eab-4a95-9244-338da02638e1): created successfully Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091870f8-c010-4ebb-aa4e-6ab7535dab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (40f057ed-89eb-4a40-9279-2e786d4e55b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:41 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e6615581-6db1-4b31-bd3e-c5e1a595be8d tempest-CreateVolumesFromImageTest-1457217307 None] Created volume successfully. Sep 25 14:04:42 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e 1073741824" returned: 0 in 0.730s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:42 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e Sep 25 14:04:42 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:42 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e" returned: 0 in 0.358s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266183350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8395cf4d-c7b0-471a-867b-47ad5dc87ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:40Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Creating volume 8395cf4d-c7b0-471a-867b-47ad5dc87ed5 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:42 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851bd0bd-9661-4fbf-aa04-8c04d1e90e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfc8987-cb17-4d10-9290-68ad2afa343e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:42 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 1073741824 Sep 25 14:04:42 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:42 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bc8e8a-6ef6-4440-b72b-fb64e888134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:43 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume volume-fbfc8987-cb17-4d10-9290-68ad2afa343e (fbfc8987-cb17-4d10-9290-68ad2afa343e): created successfully Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bc8e8a-6ef6-4440-b72b-fb64e888134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (868f3578-2f26-4097-ae89-f248e0506a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f275fdc8-6b4c-4087-b7e1-8193657517fe tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created volume successfully. Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Flow 'volume_create_manager' (924c412e-b3f1-43e0-93d7-114c13eb3eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467ac935-7253-4590-9ff1-5ebb8e8f0748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467ac935-7253-4590-9ff1-5ebb8e8f0748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1786256-d4e1-4fbf-ad5a-1c94be355198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967b0fc9105b4108bbe2a97cae1d8207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:43Z,use_quota=True,user_id='87616e598d4847d3953a15ded841d223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28b17bf-0d78-45f1-a1bb-c21d385471ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28b17bf-0d78-45f1-a1bb-c21d385471ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115c70aa-30f1-405a-b130-fe833a203b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115c70aa-30f1-405a-b130-fe833a203b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1786256-d4e1-4fbf-ad5a-1c94be355198', 'volume_name': 'volume-e1786256-d4e1-4fbf-ad5a-1c94be355198', 'volume_size': 1, 'image_id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b552a2421939e631db163209fdfe287b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '967b0fc9105b4108bbe2a97cae1d8207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed319033be040f39a08009e221fce94e338531dd42ab907acbf71c9a893ad8fa1fd831240979211cf2cea3932c6805390fc46200153894bef37a61e006fddff1', 'id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'created_at': datetime.datetime(2026, 9, 25, 12, 4, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 4, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a/file', 'properties': {}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac1e58d-8f1e-4ad3-a4a3-1ccdbe9be0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac1e58d-8f1e-4ad3-a4a3-1ccdbe9be0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fac24bd-a600-4da4-84ec-5aca3cafdadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:43 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Volume e1786256-d4e1-4fbf-ad5a-1c94be355198: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1786256-d4e1-4fbf-ad5a-1c94be355198', 'volume_size': 1, 'image_id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b552a2421939e631db163209fdfe287b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '967b0fc9105b4108bbe2a97cae1d8207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed319033be040f39a08009e221fce94e338531dd42ab907acbf71c9a893ad8fa1fd831240979211cf2cea3932c6805390fc46200153894bef37a61e006fddff1', 'id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'created_at': datetime.datetime(2026, 9, 25, 12, 4, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 4, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a/file', 'properties': {}}, 'image_service': } Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Trying to clone e1786256-d4e1-4fbf-ad5a-1c94be355198 from image b9f4379e-ad91-44b0-812d-f435e74c1e8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 14:04:43 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 1073741824" returned: 0 in 0.666s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 14:04:43 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Image download 0.00 MB at 0.00 MB/s Sep 25 14:04:43 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 Sep 25 14:04:43 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fc582e-bbca-49a3-a0a4-6def74c773f2]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:43 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD Sep 25 14:04:43 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:44 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5" returned: 0 in 0.362s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-745337722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9d932b-608b-4533-b31b-074edd629a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:41Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Creating volume fb9d932b-608b-4533-b31b-074edd629a52 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:44 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498efffd-057a-4d5c-a6a0-178b3a3a99a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec62a28-b808-44ae-be40-d80df41b0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:44 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 1073741824 Sep 25 14:04:44 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Volume volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 (8395cf4d-c7b0-471a-867b-47ad5dc87ed5): created successfully Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec62a28-b808-44ae-be40-d80df41b0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (500a7d4a-1109-42da-80bf-39cda79efc01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4455f48a-507e-405a-889c-0172037b61b3 tempest-CreateVolumesFromImageTest-1457217307 None] Created volume successfully. Sep 25 14:04:44 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:44 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD Sep 25 14:04:44 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:44 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:44 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 1073741824" returned: 0 in 0.648s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Temporary image b9f4379e-ad91-44b0-812d-f435e74c1e8a is fetched for user 87616e598d4847d3953a15ded841d223. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:44 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 Sep 25 14:04:44 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1db84e-fa43-48c3-a165-621236e5925b]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:45 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (1a9e8b00-c5e8-4bdb-98cb-771c73414b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:45 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD Sep 25 14:04:45 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511b394-3f83-43eb-acc6-b8e55e46d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52" returned: 0 in 0.427s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2025617138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54585cd5ed8142e68a7e6e4cff82f256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:41Z,use_quota=True,user_id='8ffd321c41724c9dbf561bcfb1c302bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Creating volume 1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:45 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511b394-3f83-43eb-acc6-b8e55e46d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1231101206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caea679d-61bb-4ef8-a97a-3efc5f292d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:45Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4201dd-d738-437a-9e33-1375e9a565cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4201dd-d738-437a-9e33-1375e9a565cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 1073741824 Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d7c366-dfab-4604-ab41-86a344d3c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d7c366-dfab-4604-ab41-86a344d3c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caea679d-61bb-4ef8-a97a-3efc5f292d9b', 'volume_name': 'volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fb997d-10db-4036-843f-c40b1683a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fb997d-10db-4036-843f-c40b1683a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6133b529-cd23-4a33-9677-f8e3242a5962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume caea679d-61bb-4ef8-a97a-3efc5f292d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b', 'volume_size': 1} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1ec0af-ed7b-4d84-b833-39ec0c4eaa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9d932b-608b-4533-b31b-074edd629a52', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d213ac5d-5f7f-44b6-849b-83fdf9c6037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Volume volume-fb9d932b-608b-4533-b31b-074edd629a52 (fb9d932b-608b-4533-b31b-074edd629a52): created successfully Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d213ac5d-5f7f-44b6-849b-83fdf9c6037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (93123aab-9439-4a9c-92d4-40ad5b33602a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-665ac076-0188-4a04-b04a-249fd2030b56 tempest-CreateVolumesFromImageTest-1457217307 None] Created volume successfully. Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Flow 'volume_create_manager' (50c3f8a5-dec4-484f-a291-2570c1a9f0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ad05cf-de34-4e88-a82e-7e0f7694e72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ad05cf-de34-4e88-a82e-7e0f7694e72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e443387a-3f17-493a-8594-ebb370597930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b49dcfa81e41a6bf66cc4ae7e75d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:45Z,use_quota=True,user_id='12b038ffad1142a78d118e38f874279e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f606e02-6e36-4639-83e9-fa584213661a),volume_type_id=4f606e02-6e36-4639-83e9-fa584213661a)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9711145e-314a-4c25-9e39-4108230d1c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9711145e-314a-4c25-9e39-4108230d1c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b148bda2-d350-4189-8bdc-d18cd5640830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.image.glance [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Creating Keystone auth plugin from conf {{(pid=87220) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:45 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD Sep 25 14:04:45 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (4506920d-6f3b-4c25-aaed-054f1334b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21834162-94c2-4695-b027-cdb785ae6886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21834162-94c2-4695-b027-cdb785ae6886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1263363202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bff99b3-b99f-42be-8f24-a290d776dd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:46Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4e6bc3-18a3-40c3-8ead-1a14bf925489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4e6bc3-18a3-40c3-8ead-1a14bf925489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c607b-1c9e-4953-97e5-9bec8e3cae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c607b-1c9e-4953-97e5-9bec8e3cae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bff99b3-b99f-42be-8f24-a290d776dd6e', 'volume_name': 'volume-3bff99b3-b99f-42be-8f24-a290d776dd6e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65e11ab-3892-409c-a836-c98d89c73961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65e11ab-3892-409c-a836-c98d89c73961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5679384d-5767-4783-b672-fd8294f0b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume 3bff99b3-b99f-42be-8f24-a290d776dd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bff99b3-b99f-42be-8f24-a290d776dd6e', 'volume_size': 1} Sep 25 14:04:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:46 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 1073741824" returned: 0 in 0.820s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b148bda2-d350-4189-8bdc-d18cd5640830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e443387a-3f17-493a-8594-ebb370597930', 'volume_name': 'volume-e443387a-3f17-493a-8594-ebb370597930', 'volume_size': 1, 'image_id': '6b958fda-7802-4aa1-9396-62a453866aba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b958fda-7802-4aa1-9396-62a453866aba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4819ef3679dc707eedaf6c5a5d1ab6ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53b49dcfa81e41a6bf66cc4ae7e75d25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0fdf6edbb5f8bee4c98821c2555ecae78d7957624bc37055e5659893518bec48a6808bbae4bfd2458c102d0231ccdec7a72f096a971b71321fc3d1f769e78652', 'id': '6b958fda-7802-4aa1-9396-62a453866aba', 'created_at': datetime.datetime(2026, 9, 25, 12, 4, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 4, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b958fda-7802-4aa1-9396-62a453866aba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c609207-8135-457b-8008-97ef4aa7c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c609207-8135-457b-8008-97ef4aa7c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f185f-eaed-4b5e-bb08-48dfbb64117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Volume e443387a-3f17-493a-8594-ebb370597930: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e443387a-3f17-493a-8594-ebb370597930', 'volume_size': 1, 'image_id': '6b958fda-7802-4aa1-9396-62a453866aba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b958fda-7802-4aa1-9396-62a453866aba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4819ef3679dc707eedaf6c5a5d1ab6ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53b49dcfa81e41a6bf66cc4ae7e75d25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0fdf6edbb5f8bee4c98821c2555ecae78d7957624bc37055e5659893518bec48a6808bbae4bfd2458c102d0231ccdec7a72f096a971b71321fc3d1f769e78652', 'id': '6b958fda-7802-4aa1-9396-62a453866aba', 'created_at': datetime.datetime(2026, 9, 25, 12, 4, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 4, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b958fda-7802-4aa1-9396-62a453866aba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Trying to clone e443387a-3f17-493a-8594-ebb370597930 from image 6b958fda-7802-4aa1-9396-62a453866aba at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b958fda-7802-4aa1-9396-62a453866aba', 'metadata': {}}]). {{(pid=87220) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 14:04:46 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD" returned: 1 in 0.513s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:46 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 Sep 25 14:04:46 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 14:04:46 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Image download 0.00 MB at 0.00 MB/s Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b949cdf-71a4-431b-95d3-d6e17b0b2b1f]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (beef41ea-0836-4ff5-b1ba-5278e3d50780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5a9adc-b09d-48ef-b720-a26a47d775db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.156s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1231101206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caea679d-61bb-4ef8-a97a-3efc5f292d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:45Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Creating volume caea679d-61bb-4ef8-a97a-3efc5f292d9b {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:46 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:46 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD Sep 25 14:04:46 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5a9adc-b09d-48ef-b720-a26a47d775db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90616010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24097c-1bfe-4346-a754-b2d7774bf5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:46Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33eef5b5-e548-4215-ae80-a64286461085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b 1073741824 Sep 25 14:04:46 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33eef5b5-e548-4215-ae80-a64286461085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ef00bc-2ddc-4dc1-9459-543fa7052b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ef00bc-2ddc-4dc1-9459-543fa7052b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf24097c-1bfe-4346-a754-b2d7774bf5ef', 'volume_name': 'volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6033c1b-8846-4277-9ca6-5de40d9da2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6033c1b-8846-4277-9ca6-5de40d9da2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd42729b-5585-4939-92ca-7400eb690789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume bf24097c-1bfe-4346-a754-b2d7774bf5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef', 'volume_size': 1} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a27778-3f24-4648-8861-9c494e0a1c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f89341f-c90b-4f02-a5f3-7eac497df714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Volume volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 (1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68): created successfully Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f89341f-c90b-4f02-a5f3-7eac497df714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Flow 'volume_create_manager' (24d8591f-d5de-4a1c-ae81-f00bd386ac94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fd321f42-9738-497d-86f4-0b15dcc27be7 tempest-CreateVolumesFromImageTest-1457217307 None] Created volume successfully. Sep 25 14:04:46 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (f6408767-08f3-4fba-8df7-1385cb006f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8aed82-2241-4336-b4ad-57b4d707283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8aed82-2241-4336-b4ad-57b4d707283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009414046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc30e71e-9526-44cc-b0c1-e786f0373124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:47Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431a832c-c616-4033-8cca-b50092d44f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431a832c-c616-4033-8cca-b50092d44f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520e2c39-47a4-4a04-a160-1327c89d5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520e2c39-47a4-4a04-a160-1327c89d5bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc30e71e-9526-44cc-b0c1-e786f0373124', 'volume_name': 'volume-bc30e71e-9526-44cc-b0c1-e786f0373124', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5725afda-366e-43a7-bbaa-5a03b2e07de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5725afda-366e-43a7-bbaa-5a03b2e07de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fa1962-be88-4a32-9616-9035b4a809fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume bc30e71e-9526-44cc-b0c1-e786f0373124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc30e71e-9526-44cc-b0c1-e786f0373124', 'volume_size': 1} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b 1073741824" returned: 0 in 0.608s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:47 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b Sep 25 14:04:47 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:47 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Temporary image 6b958fda-7802-4aa1-9396-62a453866aba is fetched for user 12b038ffad1142a78d118e38f874279e. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 14:04:47 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b" returned: 0 in 0.316s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1263363202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bff99b3-b99f-42be-8f24-a290d776dd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:46Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Creating volume 3bff99b3-b99f-42be-8f24-a290d776dd6e {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:47 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:47 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e 1073741824 Sep 25 14:04:47 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f5df6-29d1-487b-8f50-b58e74700470]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6133b529-cd23-4a33-9677-f8e3242a5962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e109ebc-9589-4d79-91d5-9e5022218f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b (caea679d-61bb-4ef8-a97a-3efc5f292d9b): created successfully Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e109ebc-9589-4d79-91d5-9e5022218f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD Sep 25 14:04:47 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (1a9e8b00-c5e8-4bdb-98cb-771c73414b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (3df20e9b-f006-4460-b1b8-fe5c0ec757e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5652c2fd-6581-4023-b6df-0935bcd3361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7a3442aa-8212-4c9d-a064-0323ecc926f1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created volume successfully. Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5652c2fd-6581-4023-b6df-0935bcd3361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967123396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18620ce-d19d-4116-ab43-81b17b6f0c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:48Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa6cb68-86ba-4b46-b862-b9a06978ada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa6cb68-86ba-4b46-b862-b9a06978ada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd516470-8b6e-429a-bc7c-fe1820d36595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd516470-8b6e-429a-bc7c-fe1820d36595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18620ce-d19d-4116-ab43-81b17b6f0c29', 'volume_name': 'volume-b18620ce-d19d-4116-ab43-81b17b6f0c29', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01347c43-63b9-412e-92e2-ef5f55b54e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01347c43-63b9-412e-92e2-ef5f55b54e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941254e8-3412-453c-8e80-e6880cb8c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume b18620ce-d19d-4116-ab43-81b17b6f0c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18620ce-d19d-4116-ab43-81b17b6f0c29', 'volume_size': 1} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-quobyte-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d02498-581a-4492-abba-4583aa2e318a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:48 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:48 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 Sep 25 14:04:48 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:48 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e 1073741824" returned: 0 in 0.565s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:48 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e Sep 25 14:04:48 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:48 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD Sep 25 14:04:48 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:48 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68" returned: 0 in 0.446s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:48 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68 Sep 25 14:04:48 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:48 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:48 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1786256-d4e1-4fbf-ad5a-1c94be355198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967b0fc9105b4108bbe2a97cae1d8207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:43Z,use_quota=True,user_id='87616e598d4847d3953a15ded841d223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Creating volume e1786256-d4e1-4fbf-ad5a-1c94be355198 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:48 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:48 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 1073741824 Sep 25 14:04:48 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5679384d-5767-4783-b672-fd8294f0b676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bff99b3-b99f-42be-8f24-a290d776dd6e', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fabd646-a335-4b4d-936c-352b128c1637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume volume-3bff99b3-b99f-42be-8f24-a290d776dd6e (3bff99b3-b99f-42be-8f24-a290d776dd6e): created successfully Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fabd646-a335-4b4d-936c-352b128c1637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (4506920d-6f3b-4c25-aaed-054f1334b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e276cb32-6aec-4ba1-b8e9-bbbb90d8bc64 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created volume successfully. Sep 25 14:04:48 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68" returned: 0 in 0.324s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68" released by "delete_volume" :: held 0.815s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Created reservations ['ad04e140-ff34-4b7f-86aa-072b79af0dbd', 'bec1c47e-56f3-4abf-aa6a-7529ba7c6d22', '41790a59-d2d9-42d0-abc8-c077660901c3', '8d2c1ac6-6a4f-404d-81c5-0b46e49b9313'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:48 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:48 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:49 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 1073741824" returned: 0 in 0.510s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:49 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 Sep 25 14:04:49 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:49 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.262s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Deleted volume successfully. Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8a215f33-b961-421b-86a6-3b9bb2dc52c1 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-1e1bb6a9-c79a-4e8b-9222-fcc65fd9ef68-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:49 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198" returned: 0 in 0.271s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90616010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24097c-1bfe-4346-a754-b2d7774bf5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:46Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Creating volume bf24097c-1bfe-4346-a754-b2d7774bf5ef {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:49 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:49 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef 1073741824 Sep 25 14:04:49 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Attempting download of b9f4379e-ad91-44b0-812d-f435e74c1e8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'metadata': {}}])) to volume e1786256-d4e1-4fbf-ad5a-1c94be355198. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ef078-1a80-44b0-ac41-401318ca16b4]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:49 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze Sep 25 14:04:49 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:49 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze" returned: 0 in 0.349s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:49 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef 1073741824" returned: 0 in 0.500s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:49 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze Sep 25 14:04:49 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:49 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef Sep 25 14:04:49 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-fb9d932b-608b-4533-b31b-074edd629a52-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-fb9d932b-608b-4533-b31b-074edd629a52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-quobyte-fb9d932b-608b-4533-b31b-074edd629a52" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-fb9d932b-608b-4533-b31b-074edd629a52" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef58eb-7f3b-4560-abb0-6a84dfa0535e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:50 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef" returned: 0 in 0.303s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:50 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.076s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009414046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc30e71e-9526-44cc-b0c1-e786f0373124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:47Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Creating volume bc30e71e-9526-44cc-b0c1-e786f0373124 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:50 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze" returned: 1 in 0.472s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f4379e-ad91-44b0-812d-f435e74c1e8a_bcvbvhze' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c3ac1-8598-450e-bae0-3f88642b8c40]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:50 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 Sep 25 14:04:50 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:50 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 1073741824 Sep 25 14:04:50 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd42729b-5585-4939-92ca-7400eb690789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57db7a2a-741b-49b2-8e09-91fb315cf1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:50 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef (bf24097c-1bfe-4346-a754-b2d7774bf5ef): created successfully Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57db7a2a-741b-49b2-8e09-91fb315cf1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (beef41ea-0836-4ff5-b1ba-5278e3d50780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-09dfeb19-288b-4d9c-9520-215177631db1 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created volume successfully. Sep 25 14:04:50 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD Sep 25 14:04:50 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:50 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52" returned: 0 in 0.552s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:50 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52 Sep 25 14:04:50 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:50 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:50 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 1073741824" returned: 0 in 0.686s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:50 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD Sep 25 14:04:50 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:51 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fb9d932b-608b-4533-b31b-074edd629a52" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-fb9d932b-608b-4533-b31b-074edd629a52" released by "delete_volume" :: held 0.958s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:51 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 Sep 25 14:04:51 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Created reservations ['77b67a07-d44d-43e5-b999-5730cd8ac0a5', 'c2db51ef-9173-44df-a2bb-712176bc20c7', '79492dcb-46bf-443c-b344-19a4dbcdc988', '7352e75d-ea1b-475a-8af5-17ea302142b4'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:51 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:51 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD" returned: 1 in 0.562s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] b9f4379e-ad91-44b0-812d-f435e74c1e8a was raw, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 14:04:51 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:51 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124" returned: 0 in 0.367s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.481s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967123396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18620ce-d19d-4116-ab43-81b17b6f0c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f40cccd8974cab88328f6343910463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:48Z,use_quota=True,user_id='296703a1793e404e87fec7fb5bddb482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Creating volume b18620ce-d19d-4116-ab43-81b17b6f0c29 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:51 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 Sep 25 14:04:51 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:51 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fa1962-be88-4a32-9616-9035b4a809fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc30e71e-9526-44cc-b0c1-e786f0373124', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:51 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 1073741824 Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a9d82f-b1cc-4a7b-b319-88b514fc0c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:51 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume volume-bc30e71e-9526-44cc-b0c1-e786f0373124 (bc30e71e-9526-44cc-b0c1-e786f0373124): created successfully Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a9d82f-b1cc-4a7b-b319-88b514fc0c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (f6408767-08f3-4fba-8df7-1385cb006f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f8c6eefe-0b2b-41e9-a2f8-89b2017fdb85 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created volume successfully. Sep 25 14:04:51 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Deleted volume successfully. Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4726b582-c1e3-4596-aae2-714ba3cb310e tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-fb9d932b-608b-4533-b31b-074edd629a52-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:51 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198" returned: 0 in 0.574s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f4379e-ad91-44b0-812d-f435e74c1e8a_57kr8ltydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:04:51 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:51 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 1G Sep 25 14:04:51 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:51 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 1073741824" returned: 0 in 0.597s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:52 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 Sep 25 14:04:52 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:52 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 1G" returned: 0 in 0.396s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Downloaded image b9f4379e-ad91-44b0-812d-f435e74c1e8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'metadata': {}}])) to volume e1786256-d4e1-4fbf-ad5a-1c94be355198 successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Temporary image b9f4379e-ad91-44b0-812d-f435e74c1e8a for user 87616e598d4847d3953a15ded841d223 is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Marking volume e1786256-d4e1-4fbf-ad5a-1c94be355198 as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 14:04:52 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29" returned: 0 in 0.303s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.881s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e443387a-3f17-493a-8594-ebb370597930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b49dcfa81e41a6bf66cc4ae7e75d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:04:45Z,use_quota=True,user_id='12b038ffad1142a78d118e38f874279e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f606e02-6e36-4639-83e9-fa584213661a),volume_type_id=4f606e02-6e36-4639-83e9-fa584213661a)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Creating volume e443387a-3f17-493a-8594-ebb370597930 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:04:52 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-8395cf4d-c7b0-471a-867b-47ad5dc87ed5-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Copying metadata from image b9f4379e-ad91-44b0-812d-f435e74c1e8a to e1786256-d4e1-4fbf-ad5a-1c94be355198. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Creating volume glance metadata for volume e1786256-d4e1-4fbf-ad5a-1c94be355198 backed by image b9f4379e-ad91-44b0-812d-f435e74c1e8a with: {'image_id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b552a2421939e631db163209fdfe287b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 14:04:52 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 1073741824 Sep 25 14:04:52 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941254e8-3412-453c-8e80-e6880cb8c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18620ce-d19d-4116-ab43-81b17b6f0c29', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb057c2e-f1ad-42f7-a6dd-e7cc84ba1bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-8395cf4d-c7b0-471a-867b-47ad5dc87ed5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:52 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Volume volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 (b18620ce-d19d-4116-ab43-81b17b6f0c29): created successfully Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb057c2e-f1ad-42f7-a6dd-e7cc84ba1bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Flow 'volume_create_manager' (3df20e9b-f006-4460-b1b8-fe5c0ec757e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-919bb7da-69b7-45e9-b0b3-d38de5f05f3a tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created volume successfully. Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-quobyte-8395cf4d-c7b0-471a-867b-47ad5dc87ed5" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-8395cf4d-c7b0-471a-867b-47ad5dc87ed5" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fac24bd-a600-4da4-84ec-5aca3cafdadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1786256-d4e1-4fbf-ad5a-1c94be355198', 'volume_size': 1, 'image_id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b552a2421939e631db163209fdfe287b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '967b0fc9105b4108bbe2a97cae1d8207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed319033be040f39a08009e221fce94e338531dd42ab907acbf71c9a893ad8fa1fd831240979211cf2cea3932c6805390fc46200153894bef37a61e006fddff1', 'id': 'b9f4379e-ad91-44b0-812d-f435e74c1e8a', 'created_at': datetime.datetime(2026, 9, 25, 12, 4, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 4, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f4379e-ad91-44b0-812d-f435e74c1e8a/file', 'properties': {}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a38f846-849f-4687-b7f3-4e1939c6da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[44585331-235c-4977-a564-de0890017fee]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:52 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Volume volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 (e1786256-d4e1-4fbf-ad5a-1c94be355198): created successfully Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a38f846-849f-4687-b7f3-4e1939c6da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Flow 'volume_create_manager' (924c412e-b3f1-43e0-93d7-114c13eb3eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-483b35f5-6a89-4858-956b-0e7b53086cb2 tempest-VolumeImageDependencyTests-1508177473 None] Created volume successfully. Sep 25 14:04:52 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 Sep 25 14:04:52 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Acquiring lock "cinder-e1786256-d4e1-4fbf-ad5a-1c94be355198-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:52 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 1073741824" returned: 0 in 0.613s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Lock "cinder-e1786256-d4e1-4fbf-ad5a-1c94be355198-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Acquiring lock "cinder-quobyte-e1786256-d4e1-4fbf-ad5a-1c94be355198" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:53 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 Sep 25 14:04:53 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Lock "cinder-quobyte-e1786256-d4e1-4fbf-ad5a-1c94be355198" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae72c5-bde0-4ea1-a5be-46b4138e6e48]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5" returned: 0 in 0.524s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5 Sep 25 14:04:53 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 Sep 25 14:04:53 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930" returned: 0 in 0.308s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-b18620ce-d19d-4116-ab43-81b17b6f0c29-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Attempting download of 6b958fda-7802-4aa1-9396-62a453866aba ((None, [{'url': 'file:///opt/stack/data/glance/images/6b958fda-7802-4aa1-9396-62a453866aba', 'metadata': {}}])) to volume e443387a-3f17-493a-8594-ebb370597930. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-b18620ce-d19d-4116-ab43-81b17b6f0c29-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06dc67b-a104-4e6a-8d62-1e8137ef6bc7]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-quobyte-b18620ce-d19d-4116-ab43-81b17b6f0c29" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:53 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-b18620ce-d19d-4116-ab43-81b17b6f0c29" acquired by "delete_volume" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8395cf4d-c7b0-471a-867b-47ad5dc87ed5" returned: 0 in 0.430s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-8395cf4d-c7b0-471a-867b-47ad5dc87ed5" released by "delete_volume" :: held 1.022s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83e1f80-de87-491b-a7b3-c4a4480acc3b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198" returned: 0 in 0.488s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198 Sep 25 14:04:53 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3 Sep 25 14:04:53 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Created reservations ['97cfd32d-210e-4311-8c85-225d9498485a', '6319a3c1-4fcf-4c2a-8212-1b5eddbab0be', '6eef1e59-e1d9-41b8-a20b-ad58f9bd84f7', '8a8d5c0d-cc64-4070-9e07-f7966c089ed3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:53 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 Sep 25 14:04:53 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:53 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:53 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:53 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e1786256-d4e1-4fbf-ad5a-1c94be355198" returned: 0 in 0.331s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Lock "cinder-quobyte-e1786256-d4e1-4fbf-ad5a-1c94be355198" released by "delete_volume" :: held 0.878s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:53 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3" returned: 0 in 0.472s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Created reservations ['4574c982-2934-4135-9dc7-9bb5045da47f', '93fd5f97-d136-4ca2-91b4-e937f57878cc', 'e4c5e378-a117-4c96-9c7b-f6138e191e7f', '792ccd48-7b8d-47c3-a095-c5a81e6f03dd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29" returned: 0 in 0.460s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29 Sep 25 14:04:54 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:54 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3 Sep 25 14:04:54 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Deleted volume successfully. Sep 25 14:04:54 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:54 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-a3716b5e-bfd7-48d9-a130-e49e11482868 tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-8395cf4d-c7b0-471a-867b-47ad5dc87ed5-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:54 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b18620ce-d19d-4116-ab43-81b17b6f0c29" returned: 0 in 0.354s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-b18620ce-d19d-4116-ab43-81b17b6f0c29" released by "delete_volume" :: held 0.881s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:54 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3" returned: 1 in 0.475s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b958fda-7802-4aa1-9396-62a453866aba_yhaxh8y3' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b8afe5-263f-475f-9170-d8b5ab24551d]: (4, 'raw') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.306s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created reservations ['4cc1f8dd-09ba-47dc-9334-6efb29b6c19f', 'b0927579-403d-42b7-955e-6811e12e36d9', '43ec8cd5-c5f9-422a-b03a-cee7986e1cd8', '5575cf0a-382c-4155-984c-1e451a4594fe'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Deleted volume successfully. Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9691cba1-a15e-4007-a7af-b7bea8a39560 tempest-VolumeImageDependencyTests-1508177473 None] Lock "cinder-e1786256-d4e1-4fbf-ad5a-1c94be355198-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:54 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD Sep 25 14:04:54 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:54 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-bc30e71e-9526-44cc-b0c1-e786f0373124-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-f2956fb4-7eab-4a95-9244-338da02638e1-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-f2956fb4-7eab-4a95-9244-338da02638e1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-bc30e71e-9526-44cc-b0c1-e786f0373124-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-quobyte-f2956fb4-7eab-4a95-9244-338da02638e1" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-quobyte-bc30e71e-9526-44cc-b0c1-e786f0373124" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-f2956fb4-7eab-4a95-9244-338da02638e1" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:54 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-bc30e71e-9526-44cc-b0c1-e786f0373124" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b983b4d-4b90-4650-bba1-370f429d6489]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4847c4-7805-4ed7-9226-74e3e3ee1d9e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:55 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.446s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:55 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 Sep 25 14:04:55 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Deleted volume successfully. Sep 25 14:04:55 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD Sep 25 14:04:55 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ab713ad5-7a73-4e00-8b0b-92bb0067cf1d tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-b18620ce-d19d-4116-ab43-81b17b6f0c29-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:55 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 Sep 25 14:04:55 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:55 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD" returned: 1 in 0.463s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] 6b958fda-7802-4aa1-9396-62a453866aba was raw, converting to qcow2 {{(pid=87220) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:55 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:55 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 Sep 25 14:04:55 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1" returned: 0 in 0.525s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:55 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1 Sep 25 14:04:55 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:55 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124" returned: 0 in 0.562s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:55 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124 Sep 25 14:04:55 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:55 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc30e71e-9526-44cc-b0c1-e786f0373124" returned: 0 in 0.307s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:55 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-bc30e71e-9526-44cc-b0c1-e786f0373124" released by "delete_volume" :: held 0.948s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-f2956fb4-7eab-4a95-9244-338da02638e1" returned: 0 in 0.420s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-f2956fb4-7eab-4a95-9244-338da02638e1" released by "delete_volume" :: held 1.020s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:55 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created reservations ['d5d33cea-9cd7-4796-8297-fd37a89e6c0f', '21c06b93-6e53-42d8-a98f-49808fb2ed45', '7880aa9f-954c-43f5-a407-d7b2f3c1e545', '2b7ed773-5e33-41c1-a246-f9a77905bfff'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Created reservations ['41a1a6a8-576e-44c3-8e0e-6742998790c5', 'fb91b6d8-a67c-4505-b56f-892cddfdb0a2', '32f151ef-1d5e-4a3d-8fc7-cbcab29f6a05', '79e42552-7e76-452c-912b-2e1e72993308'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:56 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930" returned: 0 in 0.645s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b958fda-7802-4aa1-9396-62a453866aba_vq7p261fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:04:56 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:56 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 1G Sep 25 14:04:56 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:56 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:56 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:56 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:56 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:56 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 1G" returned: 0 in 0.504s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Downloaded image 6b958fda-7802-4aa1-9396-62a453866aba ((None, [{'url': 'file:///opt/stack/data/glance/images/6b958fda-7802-4aa1-9396-62a453866aba', 'metadata': {}}])) to volume e443387a-3f17-493a-8594-ebb370597930 successfully. {{(pid=87220) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Temporary image 6b958fda-7802-4aa1-9396-62a453866aba for user 12b038ffad1142a78d118e38f874279e is deleted. {{(pid=87220) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.volume_utils [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Marking volume e443387a-3f17-493a-8594-ebb370597930 as bootable. {{(pid=87220) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Copying metadata from image 6b958fda-7802-4aa1-9396-62a453866aba to e443387a-3f17-493a-8594-ebb370597930. {{(pid=87220) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Creating volume glance metadata for volume e443387a-3f17-493a-8594-ebb370597930 backed by image 6b958fda-7802-4aa1-9396-62a453866aba with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6b958fda-7802-4aa1-9396-62a453866aba', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4819ef3679dc707eedaf6c5a5d1ab6ae', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87220) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 14:04:56 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.477s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:56 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Deleted volume successfully. Sep 25 14:04:56 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.452s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67b54e02-a5a6-4a28-bd76-69d6de89edec tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-bc30e71e-9526-44cc-b0c1-e786f0373124-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:56 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Deleted volume successfully. Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bfcfca1a-8264-41ec-8d82-46d4ff494b2c tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-f2956fb4-7eab-4a95-9244-338da02638e1-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f185f-eaed-4b5e-bb08-48dfbb64117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e443387a-3f17-493a-8594-ebb370597930', 'volume_size': 1, 'image_id': '6b958fda-7802-4aa1-9396-62a453866aba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b958fda-7802-4aa1-9396-62a453866aba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4819ef3679dc707eedaf6c5a5d1ab6ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53b49dcfa81e41a6bf66cc4ae7e75d25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0fdf6edbb5f8bee4c98821c2555ecae78d7957624bc37055e5659893518bec48a6808bbae4bfd2458c102d0231ccdec7a72f096a971b71321fc3d1f769e78652', 'id': '6b958fda-7802-4aa1-9396-62a453866aba', 'created_at': datetime.datetime(2026, 9, 25, 12, 4, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 4, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b958fda-7802-4aa1-9396-62a453866aba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c96894e-61e2-42f8-bbce-b4086443e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:04:56 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Volume volume-e443387a-3f17-493a-8594-ebb370597930 (e443387a-3f17-493a-8594-ebb370597930): created successfully Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c96894e-61e2-42f8-bbce-b4086443e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:04:56 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Flow 'volume_create_manager' (50c3f8a5-dec4-484f-a291-2570c1a9f0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:04:56 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-dc5fa53d-7186-4e5e-b4a6-dab57f35ab55 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Created volume successfully. Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-bf24097c-1bfe-4346-a754-b2d7774bf5ef-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-bf24097c-1bfe-4346-a754-b2d7774bf5ef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-quobyte-bf24097c-1bfe-4346-a754-b2d7774bf5ef" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "cinder-quobyte-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-bf24097c-1bfe-4346-a754-b2d7774bf5ef" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193" acquired by "delete_volume" :: waited 0.050s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[68445296-e37f-4f56-966c-17f2e2f57c0c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[de050339-fab6-4ef2-a68d-db9e4d991c26]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Acquiring lock "cinder-e443387a-3f17-493a-8594-ebb370597930-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "cinder-e443387a-3f17-493a-8594-ebb370597930-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:57 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 Sep 25 14:04:57 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Acquiring lock "cinder-quobyte-e443387a-3f17-493a-8594-ebb370597930" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:57 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef Sep 25 14:04:57 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "cinder-quobyte-e443387a-3f17-493a-8594-ebb370597930" acquired by "delete_volume" :: waited 0.031s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f806b56-784e-4825-8a47-a2102c4417eb]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:57 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 Sep 25 14:04:57 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:57 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193" returned: 0 in 0.507s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:57 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193 Sep 25 14:04:57 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:57 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef" returned: 0 in 0.675s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:57 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef Sep 25 14:04:57 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:58 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930" returned: 0 in 0.502s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:58 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930 Sep 25 14:04:58 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:58 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-quobyte-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193" released by "delete_volume" :: held 0.915s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Created reservations ['a116036b-2005-43c4-9a18-a4cb512e1449', '4154497a-fb39-4927-a58a-26ccb1af894f', '4f2e5380-06ac-4e1c-af50-77fcae7e28ad', '455310b0-1414-41d2-a3d4-9a5dab98cbc6'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:58 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bf24097c-1bfe-4346-a754-b2d7774bf5ef" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-bf24097c-1bfe-4346-a754-b2d7774bf5ef" released by "delete_volume" :: held 1.153s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:58 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:58 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created reservations ['9f2700ef-450d-4343-931a-9145e03b068c', '0082ff28-b395-49ec-b550-ec2b61ffe04f', '5b4fe370-0c57-42cf-997f-06795abb97d7', 'efa6c43f-2618-43ea-96e0-2977eff5fbbd'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:58 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-e443387a-3f17-493a-8594-ebb370597930" returned: 0 in 0.484s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "cinder-quobyte-e443387a-3f17-493a-8594-ebb370597930" released by "delete_volume" :: held 1.059s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Created reservations ['eb03f824-e367-4aa8-8558-450c528a314c', 'bccf2e19-62ae-46a1-bb71-1eb420d5ebfd', '3178c4aa-9dfe-4ed0-a761-5507fbe1e917', 'df6864b5-be85-43e1-9d5f-66a6679219b3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:04:58 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:58 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:58 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Deleted volume successfully. Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5ad164c7-2eea-43eb-bd37-5344b248e26d tempest-CreateVolumesFromImageTest-1457217307 None] Lock "cinder-1b3bafb9-6da9-4fcf-b0c8-5ec5cadb7193-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:04:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:58 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:04:58 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:04:59 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.363s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Deleted volume successfully. Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-c0deec7c-6e9b-4cdc-a977-ede8f1733001 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-bf24097c-1bfe-4346-a754-b2d7774bf5ef-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:59 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.355s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:04:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Deleted volume successfully. Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-00c71f42-6267-4ec4-980f-cd75f0000d91 tempest-VolumeAndVolumeTypeFromImageTest-1677941574 None] Lock "cinder-e443387a-3f17-493a-8594-ebb370597930-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-3bff99b3-b99f-42be-8f24-a290d776dd6e-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-3bff99b3-b99f-42be-8f24-a290d776dd6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-quobyte-3bff99b3-b99f-42be-8f24-a290d776dd6e" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-3bff99b3-b99f-42be-8f24-a290d776dd6e" acquired by "delete_volume" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9396603f-2a0e-47df-a62d-5d01a50db804]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:04:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:04:59 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e Sep 25 14:04:59 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:00 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e" returned: 0 in 0.652s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:00 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e Sep 25 14:05:00 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:00 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-3bff99b3-b99f-42be-8f24-a290d776dd6e" returned: 0 in 0.408s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-3bff99b3-b99f-42be-8f24-a290d776dd6e" released by "delete_volume" :: held 1.121s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created reservations ['cfde53b1-2c1c-4b1a-bdb5-857fffe050a0', '47f67fa9-4b22-4138-b8af-b8f6b421218d', '36209c2b-ea03-4605-b591-c7bbdc5e61b4', 'c28cd860-37db-47dc-afea-5c555b7c28a3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-87c4d67d-d80e-4876-9755-df16e6674abd tempest-ProjectAdminTests-801231643 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3816757202148, 'free_capacity_gb': 1775.3816757202148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87220) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:00 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:00 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:01 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.314s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Deleted volume successfully. Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bf5c2ef5-f7a4-45fe-8ed5-a5b464b241c3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-3bff99b3-b99f-42be-8f24-a290d776dd6e-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-caea679d-61bb-4ef8-a97a-3efc5f292d9b-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-caea679d-61bb-4ef8-a97a-3efc5f292d9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-quobyte-caea679d-61bb-4ef8-a97a-3efc5f292d9b" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-caea679d-61bb-4ef8-a97a-3efc5f292d9b" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeee17f-740a-4aef-b631-ac7c991b2ce8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:02 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b Sep 25 14:05:02 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:02 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b" returned: 0 in 0.566s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:02 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b Sep 25 14:05:02 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:02 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-caea679d-61bb-4ef8-a97a-3efc5f292d9b" returned: 0 in 0.374s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-caea679d-61bb-4ef8-a97a-3efc5f292d9b" released by "delete_volume" :: held 1.005s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:02 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created reservations ['2eef40b9-195f-4c96-b684-094ce093cb18', 'c07eb9b3-5e98-4532-bf2d-1eac91e4b6a9', '4a3a4ac3-7747-4c70-8055-a441c528e39c', '61ce76e3-2dcd-4bcd-9e03-94279091a108'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:03 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:03 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:03 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Deleted volume successfully. Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2bb2ffeb-aff7-4f70-818e-9782c4d7d5a3 tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-caea679d-61bb-4ef8-a97a-3efc5f292d9b-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Flow 'volume_create_manager' (6185efd5-da38-42ff-ad27-7a83e295d6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f76b9a5-01de-4750-937a-c923660ef5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f76b9a5-01de-4750-937a-c923660ef5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1551600720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd5cfdd-84d3-4a46-8808-4ae674fabee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90119bfbacf4baf8a2e15e9d92b78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:04Z,use_quota=True,user_id='defbbbb447414bf1afa10473ce5c6d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e79937-8ff3-4911-bfc0-2fe349345261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e79937-8ff3-4911-bfc0-2fe349345261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3037499-c7ce-4d99-a13b-0b5c1cf936ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3037499-c7ce-4d99-a13b-0b5c1cf936ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd5cfdd-84d3-4a46-8808-4ae674fabee6', 'volume_name': 'volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6f03b9-e453-4d2d-8d20-82f717fe45a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6f03b9-e453-4d2d-8d20-82f717fe45a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c99364-5650-4012-8896-cf54bb3caab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:03 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Volume 8cd5cfdd-84d3-4a46-8808-4ae674fabee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6', 'volume_size': 1} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1551600720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd5cfdd-84d3-4a46-8808-4ae674fabee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90119bfbacf4baf8a2e15e9d92b78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:04Z,use_quota=True,user_id='defbbbb447414bf1afa10473ce5c6d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Creating volume 8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:03 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:03 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 1073741824 Sep 25 14:05:03 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-fbfc8987-cb17-4d10-9290-68ad2afa343e-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-fbfc8987-cb17-4d10-9290-68ad2afa343e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "cinder-quobyte-fbfc8987-cb17-4d10-9290-68ad2afa343e" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-fbfc8987-cb17-4d10-9290-68ad2afa343e" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56a055-e463-425b-a070-bee566d17ebe]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:04 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e Sep 25 14:05:04 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:04 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 1073741824" returned: 0 in 0.692s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:04 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 Sep 25 14:05:04 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:04 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e" returned: 0 in 0.616s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:04 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e Sep 25 14:05:04 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:04 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" returned: 0 in 0.344s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c99364-5650-4012-8896-cf54bb3caab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7a0a83-d045-4e9d-a85b-de01aedc73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:05 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Volume volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 (8cd5cfdd-84d3-4a46-8808-4ae674fabee6): created successfully Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7a0a83-d045-4e9d-a85b-de01aedc73cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Flow 'volume_create_manager' (6185efd5-da38-42ff-ad27-7a83e295d6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b7a72a80-0309-4be6-8509-6326af8394e7 tempest-VolumeDependencyTests-1119922101 None] Created volume successfully. Sep 25 14:05:05 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fbfc8987-cb17-4d10-9290-68ad2afa343e" returned: 0 in 0.366s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-quobyte-fbfc8987-cb17-4d10-9290-68ad2afa343e" released by "delete_volume" :: held 1.053s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Created reservations ['dffd03ce-bdf3-41e9-85bb-87f48e784d0f', 'eb1b676b-e7ba-4163-be7a-9b04a77f27a2', '92b37bf8-1a8b-4e40-821f-ae5f88909b0c', '8f8e1615-a89e-44bf-8a02-28a9288d82c5'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:05 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:05 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:05 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.380s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Deleted volume successfully. Sep 25 14:05:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-896afaa9-dd70-4976-9edf-9dcadf47020c tempest-CreateVolumesFromSourceVolumeTest-853819144 None] Lock "cinder-fbfc8987-cb17-4d10-9290-68ad2afa343e-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Creating offline snapshot 69940008-aba3-4fce-a36a-86c3479b636f of volume 8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1259b4a-32bc-4e66-a485-0518770d138f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:06 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 Sep 25 14:05:06 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:06 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" returned: 0 in 0.549s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:06 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f 1G Sep 25 14:05:06 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:07 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f 1G" returned: 0 in 0.624s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:07 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f Sep 25 14:05:07 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:08 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f" returned: 0 in 0.539s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:08 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f is being set with open permissions: ugo+rw Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:08 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f Sep 25 14:05:08 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:08 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f" returned: 0 in 0.428s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:08 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info Sep 25 14:05:08 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (a0f73581-319a-4160-a467-feb62a2a46f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc282d41-f896-4dc0-8cd0-9ad718db2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc282d41-f896-4dc0-8cd0-9ad718db2712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277780870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10e67db-d668-4077-974a-2ec89a7b9984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:09Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c843fff2-2316-4410-a483-a96f52627531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c843fff2-2316-4410-a483-a96f52627531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f6e4ce-6013-487e-aa4a-a90e54674e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f6e4ce-6013-487e-aa4a-a90e54674e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10e67db-d668-4077-974a-2ec89a7b9984', 'volume_name': 'volume-b10e67db-d668-4077-974a-2ec89a7b9984', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68be3f44-5c21-48c4-82e1-296b90a80070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68be3f44-5c21-48c4-82e1-296b90a80070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0357a75-4abe-4bf2-a7e1-453adbd38bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:08 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume b10e67db-d668-4077-974a-2ec89a7b9984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10e67db-d668-4077-974a-2ec89a7b9984', 'volume_size': 1} Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:08 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info" returned: 0 in 0.373s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:08 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info is being set with open permissions: ugo+rw Sep 25 14:05:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:09 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info Sep 25 14:05:09 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:09 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.info" returned: 0 in 0.304s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277780870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10e67db-d668-4077-974a-2ec89a7b9984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:09Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating volume b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:09 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:09 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 1073741824 Sep 25 14:05:09 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-326f146b-5dba-4b7f-a8ab-7aaa8189aae1 tempest-VolumeDependencyTests-1119922101 None] Create snapshot completed successfully Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:10 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:10 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:10 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 1073741824" returned: 0 in 0.725s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:10 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 Sep 25 14:05:10 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:10 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.469s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:10 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Flow 'volume_create_manager' (aba77dbb-15a4-4a57-aa8a-38ca820b6568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a04fa96-a09b-4ddd-b9b4-a3eda7a36d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984" returned: 0 in 0.596s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a04fa96-a09b-4ddd-b9b4-a3eda7a36d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1787570082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c9b5d6-ccfc-4390-b750-0f90a2d306f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90119bfbacf4baf8a2e15e9d92b78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69940008-aba3-4fce-a36a-86c3479b636f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:11Z,use_quota=True,user_id='defbbbb447414bf1afa10473ce5c6d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b0127d-fbbc-4fa2-955c-6930694e0e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b0127d-fbbc-4fa2-955c-6930694e0e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5987aa3b-abb3-4eff-84e9-827ab3a4aed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5987aa3b-abb3-4eff-84e9-827ab3a4aed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6c9b5d6-ccfc-4390-b750-0f90a2d306f0', 'volume_name': 'volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0', 'volume_size': 1, 'snapshot_id': '69940008-aba3-4fce-a36a-86c3479b636f'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212736aa-594d-47c7-b4ed-35b8b9dbadff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212736aa-594d-47c7-b4ed-35b8b9dbadff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67774012-9585-4ff5-856e-296f6599112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:10 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Volume b6c9b5d6-ccfc-4390-b750-0f90a2d306f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0', 'volume_size': 1, 'snapshot_id': '69940008-aba3-4fce-a36a-86c3479b636f'} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0357a75-4abe-4bf2-a7e1-453adbd38bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10e67db-d668-4077-974a-2ec89a7b9984', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58ef339-05c7-4adc-82e6-b5cb27dbeeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-quobyte-69940008-aba3-4fce-a36a-86c3479b636f-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:10 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume volume-b10e67db-d668-4077-974a-2ec89a7b9984 (b10e67db-d668-4077-974a-2ec89a7b9984): created successfully Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58ef339-05c7-4adc-82e6-b5cb27dbeeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (a0f73581-319a-4160-a467-feb62a2a46f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-69940008-aba3-4fce-a36a-86c3479b636f-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Creating volume b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 from snapshot 69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-quobyte-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-eedf2418-6178-47bd-b9e5-08aaca1458d6 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created volume successfully. Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] snapshot: 69940008-aba3-4fce-a36a-86c3479b636f, volume: b6c9b5d6-ccfc-4390-b750-0f90a2d306f0, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d86a2de-42de-4705-9f6a-08f059248e2a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:11 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f Sep 25 14:05:11 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:11 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f" returned: 0 in 0.484s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee04296-3e7c-4577-8212-2dbd6bdb2082]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:11 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 Sep 25 14:05:11 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Flow 'volume_create_manager' (62c4f437-d7c5-45e5-b890-f115a6852b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19423e0-3bc2-4539-8b90-d9954b696fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:11 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" returned: 0 in 0.495s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 14:05:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19423e0-3bc2-4539-8b90-d9954b696fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d60c3d-8fe1-48f8-8c83-443348638dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8770b8069ce41a19d017631cdce951f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:12Z,use_quota=True,user_id='acf59d682d1a4c0b92fdfe87ba5711f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:12 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 Sep 25 14:05:12 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa92cc4-1e6e-4bac-bb93-753af994d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa92cc4-1e6e-4bac-bb93-753af994d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dc95b8-b9ba-4713-928a-b7eda6a0c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dc95b8-b9ba-4713-928a-b7eda6a0c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d60c3d-8fe1-48f8-8c83-443348638dd6', 'volume_name': 'volume-77d60c3d-8fe1-48f8-8c83-443348638dd6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f474e10d-2e78-47c6-82fd-4261d8a8a75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f474e10d-2e78-47c6-82fd-4261d8a8a75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4568da-99d4-4469-adc9-b83b10acff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Volume 77d60c3d-8fe1-48f8-8c83-443348638dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d60c3d-8fe1-48f8-8c83-443348638dd6', 'volume_size': 1} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:19 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" returned: 0 in 7.302s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:05:19 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Converted 1024.00 MB image at 140.21 MB/s Sep 25 14:05:19 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 is being set with open permissions: ugo+rw Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:19 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 Sep 25 14:05:19 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:19 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" returned: 0 in 0.307s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" released by "_copy_volume_from_snapshot" :: held 8.708s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-69940008-aba3-4fce-a36a-86c3479b636f-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" released by "_create_volume_from_snapshot" :: held 8.791s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.818s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.604s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d60c3d-8fe1-48f8-8c83-443348638dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8770b8069ce41a19d017631cdce951f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:12Z,use_quota=True,user_id='acf59d682d1a4c0b92fdfe87ba5711f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Creating volume 77d60c3d-8fe1-48f8-8c83-443348638dd6 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:19 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:19 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 1073741824 Sep 25 14:05:19 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67774012-9585-4ff5-856e-296f6599112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0', 'volume_size': 1, 'snapshot_id': '69940008-aba3-4fce-a36a-86c3479b636f'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f235af6-8bde-4397-bd43-c139af809fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:19 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Volume volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 (b6c9b5d6-ccfc-4390-b750-0f90a2d306f0): created successfully Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f235af6-8bde-4397-bd43-c139af809fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:19 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Flow 'volume_create_manager' (aba77dbb-15a4-4a57-aa8a-38ca820b6568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f1115c66-42b3-4861-8ed3-d1a2108e8de6 tempest-VolumeDependencyTests-1119922101 None] Created volume successfully. Sep 25 14:05:20 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 1073741824" returned: 0 in 0.463s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:20 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 Sep 25 14:05:20 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-69940008-aba3-4fce-a36a-86c3479b636f-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:20 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-69940008-aba3-4fce-a36a-86c3479b636f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-quobyte-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.343s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4568da-99d4-4469-adc9-b83b10acff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d60c3d-8fe1-48f8-8c83-443348638dd6', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a900c1-e261-49d6-9d1c-13e7e46fdcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating offline snapshot 9760d63f-36a0-49d5-84cd-1e0bc3350f17 of volume b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-quobyte-69940008-aba3-4fce-a36a-86c3479b636f" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:20 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Volume volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 (77d60c3d-8fe1-48f8-8c83-443348638dd6): created successfully Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a900c1-e261-49d6-9d1c-13e7e46fdcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Flow 'volume_create_manager' (62c4f437-d7c5-45e5-b890-f115a6852b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-69940008-aba3-4fce-a36a-86c3479b636f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Deleting offline snapshot 69940008-aba3-4fce-a36a-86c3479b636f of volume 8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] snapshot_file for this snap is: volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2149fb-7aec-4ec0-8fee-74272bdb8849]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ec830-e5b2-4fd9-a164-3d3b870b6582]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-43d17558-180a-49ec-a5e3-b501019cf705 tempest-CinderUnicodeTest-126375844 None] Created volume successfully. Sep 25 14:05:20 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 Sep 25 14:05:20 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:20 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f Sep 25 14:05:20 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:21 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984" returned: 0 in 0.624s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:21 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f" returned: 0 in 0.619s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:05:21 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 1G Sep 25 14:05:21 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3e551-ef73-46a5-a358-2a675ba4df2a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:21 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 Sep 25 14:05:21 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Flow 'volume_create_manager' (98c28be7-6b6a-4c5c-8193-ad50af59f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1de058-925d-467c-9d65-436247b44559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1de058-925d-467c-9d65-436247b44559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1085313539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a187c5c-4330-49a4-9990-c266597f9441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8770b8069ce41a19d017631cdce951f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:22Z,use_quota=True,user_id='acf59d682d1a4c0b92fdfe87ba5711f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925407bc-b599-4c1c-a86a-de9bb7b6cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925407bc-b599-4c1c-a86a-de9bb7b6cf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e52f49f-d653-4cb5-8df4-40ec5e1415b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e52f49f-d653-4cb5-8df4-40ec5e1415b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a187c5c-4330-49a4-9990-c266597f9441', 'volume_name': 'volume-9a187c5c-4330-49a4-9990-c266597f9441', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3231f9-fa91-4e31-b80e-58f1f7a82352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3231f9-fa91-4e31-b80e-58f1f7a82352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c969ec9b-8dcd-4c0d-badf-79cf960f5cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:21 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Volume 9a187c5c-4330-49a4-9990-c266597f9441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a187c5c-4330-49a4-9990-c266597f9441', 'volume_size': 1} Sep 25 14:05:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:22 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 1G" returned: 0 in 0.748s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b10e67db-d668-4077-974a-2ec89a7b9984 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:22 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b10e67db-d668-4077-974a-2ec89a7b9984 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 Sep 25 14:05:22 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:22 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" returned: 0 in 0.764s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:22 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f Sep 25 14:05:22 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:22 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b10e67db-d668-4077-974a-2ec89a7b9984 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17" returned: 0 in 0.397s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:22 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 is being set with open permissions: ugo+rw Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:22 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 Sep 25 14:05:22 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:22 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:22 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f Sep 25 14:05:22 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:22 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17" returned: 0 in 0.371s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:22 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:22 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6.69940008-aba3-4fce-a36a-86c3479b636f" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:22 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-69940008-aba3-4fce-a36a-86c3479b636f" released by "_delete_snapshot" :: held 2.322s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:22 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" released by "delete_snapshot" :: held 2.372s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Created reservations ['318598c4-bccd-4308-aa20-96ebe975445f', '39eef0b3-4d44-44ff-9416-32737f69068d', '4315e9bf-7c55-4f6a-8640-13f33f76ffbb', '3e39064f-7c1b-416d-9832-d745ec93562b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Delete snapshot completed successfully. Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cc07194c-efe5-4717-bacc-0fd1b39b70ab tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-69940008-aba3-4fce-a36a-86c3479b636f-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:23 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info" returned: 0 in 0.347s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:23 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info is being set with open permissions: ugo+rw Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:23 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info Sep 25 14:05:23 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:23 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.info" returned: 0 in 0.289s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.989s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1085313539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a187c5c-4330-49a4-9990-c266597f9441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8770b8069ce41a19d017631cdce951f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:22Z,use_quota=True,user_id='acf59d682d1a4c0b92fdfe87ba5711f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Creating volume 9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:23 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:23 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 1073741824 Sep 25 14:05:23 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e3a6e584-7c96-4b22-9e1f-e700a6c5cbe1 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Create snapshot completed successfully Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-8cd5cfdd-84d3-4a46-8808-4ae674fabee6-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-8cd5cfdd-84d3-4a46-8808-4ae674fabee6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-quobyte-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce94a76d-d454-4348-8f54-a90a8ed739e9]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:24 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 Sep 25 14:05:24 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:24 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 1073741824" returned: 0 in 0.697s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:24 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 Sep 25 14:05:24 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (bdaa2af9-c8f0-4fb4-91c9-bcb261a0354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aabef44-841e-4436-ad30-78c0fbfccf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aabef44-841e-4436-ad30-78c0fbfccf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510978929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05197f53-5651-49dd-9bb5-6884e611e994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:25Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7505d57e-41ec-4a58-a36a-a12fc255549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7505d57e-41ec-4a58-a36a-a12fc255549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:24 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9097f527-7397-40c3-b440-4a2d048a58d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9097f527-7397-40c3-b440-4a2d048a58d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05197f53-5651-49dd-9bb5-6884e611e994', 'volume_name': 'volume-05197f53-5651-49dd-9bb5-6884e611e994', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebef31b1-802e-4127-8762-5331d988bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebef31b1-802e-4127-8762-5331d988bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccab922-5d55-4bd7-bdf8-001e79797526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:24 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:24 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume 05197f53-5651-49dd-9bb5-6884e611e994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05197f53-5651-49dd-9bb5-6884e611e994', 'volume_size': 1} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" returned: 0 in 0.783s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441" returned: 0 in 0.550s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510978929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05197f53-5651-49dd-9bb5-6884e611e994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:25Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating volume 05197f53-5651-49dd-9bb5-6884e611e994 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:24 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6 Sep 25 14:05:24 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:24 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c969ec9b-8dcd-4c0d-badf-79cf960f5cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a187c5c-4330-49a4-9990-c266597f9441', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52652da-f6e9-4cb1-ba54-bc617add1a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:24 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Volume volume-9a187c5c-4330-49a4-9990-c266597f9441 (9a187c5c-4330-49a4-9990-c266597f9441): created successfully Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52652da-f6e9-4cb1-ba54-bc617add1a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Flow 'volume_create_manager' (98c28be7-6b6a-4c5c-8193-ad50af59f799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:24 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 1073741824 Sep 25 14:05:24 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-dcc03931-a1bc-47c3-b47a-dd1217473350 tempest-CinderUnicodeTest-126375844 None] Created volume successfully. Sep 25 14:05:25 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" returned: 0 in 0.464s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-8cd5cfdd-84d3-4a46-8808-4ae674fabee6" released by "delete_volume" :: held 1.357s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Created reservations ['5aac8df9-5c06-4877-9239-8faaf6e66c1d', '654677f8-d6f0-4c48-ad63-1354b61ccbb4', 'caa89928-8e2f-4355-9ac8-9f1b834fcac0', 'bec342d4-1bc7-4ccd-9ac5-94fee2650a23'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (e473d891-5751-43d0-a051-ae707b9dc1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd81c1a-c272-4625-a976-1ba468f4c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd81c1a-c272-4625-a976-1ba468f4c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1171392149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8ae696-53d0-468d-a73f-2653872a2354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:25Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151fee59-4452-4b05-817f-bf51f0332993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151fee59-4452-4b05-817f-bf51f0332993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:25 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179c91b4-e985-4be4-a506-4eb8ed7db6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179c91b4-e985-4be4-a506-4eb8ed7db6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8ae696-53d0-468d-a73f-2653872a2354', 'volume_name': 'volume-2f8ae696-53d0-468d-a73f-2653872a2354', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43ddb9e-f544-4cee-a4cd-5fdb687501d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43ddb9e-f544-4cee-a4cd-5fdb687501d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc9f358-3e6a-4cc1-a783-9aacd04a6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:25 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume 2f8ae696-53d0-468d-a73f-2653872a2354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8ae696-53d0-468d-a73f-2653872a2354', 'volume_size': 1} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 1073741824" returned: 0 in 0.841s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:25 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:25 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:25 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 Sep 25 14:05:25 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:26 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994" returned: 0 in 0.497s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1171392149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8ae696-53d0-468d-a73f-2653872a2354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:25Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating volume 2f8ae696-53d0-468d-a73f-2653872a2354 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:26 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccab922-5d55-4bd7-bdf8-001e79797526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05197f53-5651-49dd-9bb5-6884e611e994', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:26 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 1073741824 Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb64d1d-8ba5-4f36-94d1-529a91582126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:26 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:26 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (e492e151-87d2-42f9-8976-66ac492e5c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a9d47a-c77d-48f0-b04e-fa140cb876ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:26 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume volume-05197f53-5651-49dd-9bb5-6884e611e994 (05197f53-5651-49dd-9bb5-6884e611e994): created successfully Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb64d1d-8ba5-4f36-94d1-529a91582126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (bdaa2af9-c8f0-4fb4-91c9-bcb261a0354c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.990s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a9d47a-c77d-48f0-b04e-fa140cb876ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101927636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586fca00-47c2-4a00-8ff4-1fe45f1cef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:26Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1cfc4a-038f-410c-a0b5-e7ed61b92493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1cfc4a-038f-410c-a0b5-e7ed61b92493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6383ed-5338-4910-b7d6-c2b062a29a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6383ed-5338-4910-b7d6-c2b062a29a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '586fca00-47c2-4a00-8ff4-1fe45f1cef71', 'volume_name': 'volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b214ad7-5751-4f45-bb6b-44e6eef56787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b214ad7-5751-4f45-bb6b-44e6eef56787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083c9cae-fc1a-4a30-83a4-990c661b2746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:26 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume 586fca00-47c2-4a00-8ff4-1fe45f1cef71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71', 'volume_size': 1} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Deleted volume successfully. Sep 25 14:05:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7b9f43a0-c60b-455c-a720-f55925c14045 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created volume successfully. Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:26 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8efe454b-3a17-4c25-b887-e38945e2af2f tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-8cd5cfdd-84d3-4a46-8808-4ae674fabee6-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "cinder-quobyte-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b516dfc-dada-44c3-aee3-f056aeb4963d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:27 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (055c9cf0-d4d6-42fa-a823-44e62a8337c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b053e500-07da-43af-b2db-befcd0e9036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 Sep 25 14:05:27 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 1073741824" returned: 0 in 1.067s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b053e500-07da-43af-b2db-befcd0e9036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049632020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:27Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac27b004-11bd-4d04-b34d-2dc7fb63c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac27b004-11bd-4d04-b34d-2dc7fb63c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6fc3b5-28f7-4d6a-8e85-4e37eb20f45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6fc3b5-28f7-4d6a-8e85-4e37eb20f45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b', 'volume_name': 'volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e852c5a4-a063-4c29-899b-fd66fb9bf1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e852c5a4-a063-4c29-899b-fd66fb9bf1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed6a097-f114-42b9-b289-fb980460ac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume 0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b', 'volume_size': 1} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:27 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 Sep 25 14:05:27 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:27 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" returned: 0 in 0.634s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:27 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0 Sep 25 14:05:27 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (06ac0305-04d5-47a5-8a48-7636c21d5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93248651-d317-40f5-9ddf-ef5d90d31bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93248651-d317-40f5-9ddf-ef5d90d31bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801585131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8d538f-adc5-457a-bef5-1d3d5ce28304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:28Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c64896-ecfa-458c-923b-e34f0d744e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c64896-ecfa-458c-923b-e34f0d744e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a6f6d6-e231-44cc-ad48-d24f8ab4a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:27 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a6f6d6-e231-44cc-ad48-d24f8ab4a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8d538f-adc5-457a-bef5-1d3d5ce28304', 'volume_name': 'volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e70c6d-47f6-43c2-920a-39055c362e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e70c6d-47f6-43c2-920a-39055c362e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0e2f9b-932f-4620-b865-39e17befdb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume cb8d538f-adc5-457a-bef5-1d3d5ce28304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304', 'volume_size': 1} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:28 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354" returned: 0 in 0.432s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101927636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586fca00-47c2-4a00-8ff4-1fe45f1cef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:26Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating volume 586fca00-47c2-4a00-8ff4-1fe45f1cef71 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:28 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc9f358-3e6a-4cc1-a783-9aacd04a6f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8ae696-53d0-468d-a73f-2653872a2354', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:28 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 1073741824 Sep 25 14:05:28 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d144bc0f-68b9-404d-bc46-5f70f5b91499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume volume-2f8ae696-53d0-468d-a73f-2653872a2354 (2f8ae696-53d0-468d-a73f-2653872a2354): created successfully Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d144bc0f-68b9-404d-bc46-5f70f5b91499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:28 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (e473d891-5751-43d0-a051-ae707b9dc1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-quobyte-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0" released by "delete_volume" :: held 1.129s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1e601ef6-e55b-4e54-88e1-d5d5b515e68f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created volume successfully. Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Created reservations ['4de507bf-7790-4d5c-9a59-f2c4f6c15c9c', 'e836be61-0c18-477f-8698-c5fd8cb4728f', '22d6cd5a-e115-4bd8-b15d-fd7ac652f0fa', '6f363f09-ea88-4161-83cc-05a6a57c492f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:28 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:28 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:28 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.318s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Deleted volume successfully. Sep 25 14:05:28 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 1073741824" returned: 0 in 0.643s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-99c1bd4a-d30e-4dd8-acfb-05c840a7b421 tempest-VolumeDependencyTests-1119922101 None] Lock "cinder-b6c9b5d6-ccfc-4390-b750-0f90a2d306f0-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:28 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 Sep 25 14:05:28 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:29 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71" returned: 0 in 0.280s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.773s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083c9cae-fc1a-4a30-83a4-990c661b2746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd6f74e-c793-4d03-b4f7-e4f1b871a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Creating offline snapshot 0a12c48c-6825-4000-8af6-f96e0babb0cf of volume 9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:05:29 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 (586fca00-47c2-4a00-8ff4-1fe45f1cef71): created successfully Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd6f74e-c793-4d03-b4f7-e4f1b871a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (e492e151-87d2-42f9-8976-66ac492e5c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1181363-509e-40de-854a-0cdc7eed1257]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-eba424a3-6bb2-447e-89b8-c370031205c2 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created volume successfully. Sep 25 14:05:29 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 Sep 25 14:05:29 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:29 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441" returned: 0 in 0.571s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:29 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf 1G Sep 25 14:05:29 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:30 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf 1G" returned: 0 in 0.648s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a187c5c-4330-49a4-9990-c266597f9441 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:30 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a187c5c-4330-49a4-9990-c266597f9441 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf Sep 25 14:05:30 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:30 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a187c5c-4330-49a4-9990-c266597f9441 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:30 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf is being set with open permissions: ugo+rw Sep 25 14:05:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:30 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf Sep 25 14:05:30 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:31 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf" returned: 0 in 0.358s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:31 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info Sep 25 14:05:31 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:31 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info" returned: 0 in 0.380s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:31 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info is being set with open permissions: ugo+rw Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:31 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info Sep 25 14:05:31 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:31 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.info" returned: 0 in 0.357s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.438s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049632020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:27Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating volume 0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:31 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:32 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b 1073741824 Sep 25 14:05:32 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2304b8b4-48b8-4c7e-9405-70e5e123a54f tempest-CinderUnicodeTest-126375844 None] Create snapshot completed successfully Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-0a12c48c-6825-4000-8af6-f96e0babb0cf-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-0a12c48c-6825-4000-8af6-f96e0babb0cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-quobyte-9a187c5c-4330-49a4-9990-c266597f9441" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-9a187c5c-4330-49a4-9990-c266597f9441" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-quobyte-0a12c48c-6825-4000-8af6-f96e0babb0cf" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-0a12c48c-6825-4000-8af6-f96e0babb0cf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Deleting offline snapshot 0a12c48c-6825-4000-8af6-f96e0babb0cf of volume 9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] snapshot_file for this snap is: volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b34a7-9bf4-45be-bc0e-768bc5861c9b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:32 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b 1073741824" returned: 0 in 0.729s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:32 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b Sep 25 14:05:32 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:32 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf Sep 25 14:05:32 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:33 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.134s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801585131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8d538f-adc5-457a-bef5-1d3d5ce28304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e0394730543bd85b455179e7327cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:28Z,use_quota=True,user_id='2fe5896415d246f499b94abf85eb9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Creating volume cb8d538f-adc5-457a-bef5-1d3d5ce28304 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:33 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:33 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf" returned: 0 in 0.496s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a187c5c-4330-49a4-9990-c266597f9441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:05:33 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 1073741824 Sep 25 14:05:33 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed6a097-f114-42b9-b289-fb980460ac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe358d0-7481-4dfa-8f08-16a8b5a8da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d71423-a008-4f18-89a5-f23a157eead2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:33 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b (0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b): created successfully Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe358d0-7481-4dfa-8f08-16a8b5a8da2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (055c9cf0-d4d6-42fa-a823-44e62a8337c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c5d7b61b-1a21-45e6-8ae9-cdca1e8c1884 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created volume successfully. Sep 25 14:05:33 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 Sep 25 14:05:33 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:33 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 1073741824" returned: 0 in 0.717s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:33 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441" returned: 0 in 0.613s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:33 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf Sep 25 14:05:33 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:33 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 Sep 25 14:05:33 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:34 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0e2f9b-932f-4620-b865-39e17befdb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de67bba-e18f-4cca-b38e-181f030631a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:34 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Volume volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 (cb8d538f-adc5-457a-bef5-1d3d5ce28304): created successfully Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de67bba-e18f-4cca-b38e-181f030631a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Flow 'volume_create_manager' (06ac0305-04d5-47a5-8a48-7636c21d5d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3a169d5d-e8a6-439e-87a3-788f81344e5d tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created volume successfully. Sep 25 14:05:34 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf" returned: 0 in 0.474s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:34 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf Sep 25 14:05:34 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-cb8d538f-adc5-457a-bef5-1d3d5ce28304-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-cb8d538f-adc5-457a-bef5-1d3d5ce28304-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-cb8d538f-adc5-457a-bef5-1d3d5ce28304" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:34 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441.0a12c48c-6825-4000-8af6-f96e0babb0cf" returned: 0 in 0.371s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-cb8d538f-adc5-457a-bef5-1d3d5ce28304" acquired by "delete_volume" :: waited 0.078s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (406c157c-bbe1-4253-b68a-1b0ba214d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e1b2e-909e-48b2-b48b-78a07c633e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-0a12c48c-6825-4000-8af6-f96e0babb0cf" released by "_delete_snapshot" :: held 2.243s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[de33e710-8179-435c-81ed-0f447726bb6c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-9a187c5c-4330-49a4-9990-c266597f9441" released by "delete_snapshot" :: held 2.300s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e1b2e-909e-48b2-b48b-78a07c633e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534628633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85927bbc-502c-4e22-9bbf-99d5fcab4a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:35Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e17ca91-473f-4fb2-82d0-fca637c481f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e17ca91-473f-4fb2-82d0-fca637c481f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ade7a15-1a04-452a-afef-7cf865f1b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ade7a15-1a04-452a-afef-7cf865f1b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85927bbc-502c-4e22-9bbf-99d5fcab4a85', 'volume_name': 'volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313bb858-53d0-4301-91a6-385e0fdc67f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313bb858-53d0-4301-91a6-385e0fdc67f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e40bfec-7853-490d-96a4-03bf378bbbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:34 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Volume 85927bbc-502c-4e22-9bbf-99d5fcab4a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85', 'volume_size': 1} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534628633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85927bbc-502c-4e22-9bbf-99d5fcab4a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:35Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Creating volume 85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:34 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:35 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 Sep 25 14:05:35 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:35 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 1073741824 Sep 25 14:05:35 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Created reservations ['ded4f578-6d54-4bdf-a439-e8916e1e9585', '63282241-c6b2-40bd-8001-5cbf22e7d623', 'ecb27971-07de-4bee-be65-625025fe52fa', 'd3e46ecb-7e48-460b-b892-b6c3aef1991a'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:35 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Delete snapshot completed successfully. Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea920287-6ccb-42f6-854b-d33a6f0ad034 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-0a12c48c-6825-4000-8af6-f96e0babb0cf-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:35 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304" returned: 0 in 0.653s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:35 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304 Sep 25 14:05:35 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:35 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-9a187c5c-4330-49a4-9990-c266597f9441-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 1073741824" returned: 0 in 0.924s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-9a187c5c-4330-49a4-9990-c266597f9441-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=155,cinder:UPDATE=217,cinder:INSERT=53,cinder:DELETE=27 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:05:35 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-cb8d538f-adc5-457a-bef5-1d3d5ce28304" returned: 0 in 0.431s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-cb8d538f-adc5-457a-bef5-1d3d5ce28304" released by "delete_volume" :: held 1.180s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-quobyte-9a187c5c-4330-49a4-9990-c266597f9441" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:36 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 Sep 25 14:05:36 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-9a187c5c-4330-49a4-9990-c266597f9441" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f74399-9ea5-4cd5-bab8-977e759c1c08]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=204,cinder:SELECT=168,cinder:DELETE=14,cinder:INSERT=63 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['721b68cb-baf8-4914-92db-4a04801c6952', 'c4ac4a73-5026-45c7-b0d8-1fd4e051f498', '567d6a0f-c406-4729-8ed5-afce17cd7f15', '7810c3f4-e7ff-4250-8655-ccc5d86945d3'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:36 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:36 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:36 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 Sep 25 14:05:36 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:36 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85" returned: 0 in 0.344s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e40bfec-7853-490d-96a4-03bf378bbbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46193996-6305-4749-971e-555d1d606f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:36 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Volume volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 (85927bbc-502c-4e22-9bbf-99d5fcab4a85): created successfully Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46193996-6305-4749-971e-555d1d606f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (406c157c-bbe1-4253-b68a-1b0ba214d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-eba050bd-3a93-48eb-a269-73cecc183292 tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:05:36 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.328s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleted volume successfully. Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-886819b6-cd8b-47bb-a6f2-b63382aa0fb5 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-cb8d538f-adc5-457a-bef5-1d3d5ce28304-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:36 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441" returned: 0 in 0.566s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:36 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441 Sep 25 14:05:36 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:37 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-9a187c5c-4330-49a4-9990-c266597f9441" returned: 0 in 0.354s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-9a187c5c-4330-49a4-9990-c266597f9441" released by "delete_volume" :: held 1.039s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b" acquired by "delete_volume" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Created reservations ['807a9adb-347a-4356-ae4f-5fa4eac627ce', '2a7cad60-f498-4713-8714-5a08572f5634', 'f3230e8b-2c6e-457d-8e01-536db7e172eb', 'a4a47537-7167-4ed1-8f48-0449eeb493ed'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[8479573c-736a-4c67-b920-9aa44ead086c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:37 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:37 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:37 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b Sep 25 14:05:37 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot bfaf5021-a507-45bc-9bc7-5f83289fcfe1 of volume 85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2499c813-68f8-417a-b6b4-d9b6c48fa425]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:37 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.348s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:37 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 Sep 25 14:05:37 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Deleted volume successfully. Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-6fe8049b-7522-4821-a20a-5fdedd2c0238 tempest-CinderUnicodeTest-126375844 None] Lock "cinder-9a187c5c-4330-49a4-9990-c266597f9441-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:37 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b" returned: 0 in 0.660s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:37 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b Sep 25 14:05:37 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:38 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85" returned: 0 in 0.628s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:38 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 1G Sep 25 14:05:38 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:38 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-77d60c3d-8fe1-48f8-8c83-443348638dd6-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b" released by "delete_volume" :: held 1.158s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Lock "cinder-77d60c3d-8fe1-48f8-8c83-443348638dd6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Acquiring lock "cinder-quobyte-77d60c3d-8fe1-48f8-8c83-443348638dd6" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-77d60c3d-8fe1-48f8-8c83-443348638dd6" acquired by "delete_volume" :: waited 0.037s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['7613638c-63bd-4f88-b7b2-c7b372025746', '97a5de9a-49ee-4b3c-9f95-05de796e83de', 'daf6b972-62d1-4058-b561-9ab674b0d349', '627cb93d-365e-455d-adce-3ac6e420bb86'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47c07f-aad9-44e8-aeaf-aafa04361279]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:38 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:38 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:38 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 Sep 25 14:05:38 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:38 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 1G" returned: 0 in 0.737s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:38 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 Sep 25 14:05:38 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:39 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleted volume successfully. Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4e8712ad-967f-4dbd-86e6-b53388727efc tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-0d5ded15-3637-4f0b-9dd6-bfcf8f9fa28b-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:39 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6" returned: 0 in 0.626s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:39 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6 Sep 25 14:05:39 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:39 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1" returned: 0 in 0.413s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:39 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 is being set with open permissions: ugo+rw Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:39 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 Sep 25 14:05:39 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:39 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-77d60c3d-8fe1-48f8-8c83-443348638dd6" returned: 0 in 0.342s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Lock "cinder-quobyte-77d60c3d-8fe1-48f8-8c83-443348638dd6" released by "delete_volume" :: held 1.045s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-586fca00-47c2-4a00-8ff4-1fe45f1cef71-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-586fca00-47c2-4a00-8ff4-1fe45f1cef71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Created reservations ['e804ca54-1131-4550-a49b-dd3bec82a544', 'fa09f9d3-7a89-426d-85fc-d25f4c968c1d', '87731fe4-5ba4-47cd-a527-3261a4bd46c0', '5417e49f-29e2-49cf-9b97-f3baed363ba2'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-586fca00-47c2-4a00-8ff4-1fe45f1cef71" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-586fca00-47c2-4a00-8ff4-1fe45f1cef71" acquired by "delete_volume" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9278e3-c999-476e-a3ab-32ff5c3e9ef8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:39 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1" returned: 0 in 0.473s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:39 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:39 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:39 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 Sep 25 14:05:39 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:39 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info Sep 25 14:05:39 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:40 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:40 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71" returned: 0 in 0.507s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.435s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:40 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Deleted volume successfully. Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info" returned: 0 in 0.382s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:40 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info is being set with open permissions: ugo+rw Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:40 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71 Sep 25 14:05:40 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:40 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info Sep 25 14:05:40 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d853db63-ff80-4dea-88e1-36df8898626e tempest-CinderUnicodeTest-126375844 None] Lock "cinder-77d60c3d-8fe1-48f8-8c83-443348638dd6-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:40 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.info" returned: 0 in 0.355s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:40 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.159s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-586fca00-47c2-4a00-8ff4-1fe45f1cef71" returned: 0 in 0.454s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-586fca00-47c2-4a00-8ff4-1fe45f1cef71" released by "delete_volume" :: held 1.017s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0809087e-9d2d-43f2-be67-2cb7cc59c585 tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['17a903ec-75cb-48f4-8ecb-07a8a7a8ffd9', 'dafe4c10-9640-4141-adfa-27d99c37e3d8', '84a58fe3-3225-4b6c-849b-f5471764a381', '8f10b3c9-c85d-42ce-bc1e-5f7065e09468'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:40 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:40 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:41 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.290s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:41 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleted volume successfully. Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7c443296-8f56-4ec6-8ca7-6388ddeb22fb tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-586fca00-47c2-4a00-8ff4-1fe45f1cef71-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-bfaf5021-a507-45bc-9bc7-5f83289fcfe1-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-bfaf5021-a507-45bc-9bc7-5f83289fcfe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-85927bbc-502c-4e22-9bbf-99d5fcab4a85" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-85927bbc-502c-4e22-9bbf-99d5fcab4a85" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-bfaf5021-a507-45bc-9bc7-5f83289fcfe1" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-bfaf5021-a507-45bc-9bc7-5f83289fcfe1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot bfaf5021-a507-45bc-9bc7-5f83289fcfe1 of volume 85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-2f8ae696-53d0-468d-a73f-2653872a2354-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f704641-140c-4969-b022-c08ddeb07a16]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:41 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-2f8ae696-53d0-468d-a73f-2653872a2354-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-2f8ae696-53d0-468d-a73f-2653872a2354" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-2f8ae696-53d0-468d-a73f-2653872a2354" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:42 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 Sep 25 14:05:42 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[329aab90-5eab-40d7-82bc-330f2a72df88]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:42 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 Sep 25 14:05:42 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:42 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1" returned: 0 in 0.635s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae9a94-0c35-4c10-ac1b-cfd6b72a2c75]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:42 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354" returned: 0 in 0.617s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:42 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354 Sep 25 14:05:42 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:42 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 Sep 25 14:05:42 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:43 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-2f8ae696-53d0-468d-a73f-2653872a2354" returned: 0 in 0.425s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-2f8ae696-53d0-468d-a73f-2653872a2354" released by "delete_volume" :: held 1.137s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['ebd3a68f-185e-49b1-85f7-7a0df13669d0', '2ee94cda-0e1f-408e-8b63-c70ada359ebc', 'ca7dc7f0-e1cc-4b31-81eb-ffa12ed36c4c', '37495fd3-ac46-4c29-aded-d3c2d597afbb'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:43 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85" returned: 0 in 0.744s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:43 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 Sep 25 14:05:43 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:43 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:43 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:43 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.389s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleted volume successfully. Sep 25 14:05:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-37b0a461-565b-414f-8250-173353407023 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-2f8ae696-53d0-468d-a73f-2653872a2354-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:44 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1" returned: 0 in 0.704s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:44 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1 Sep 25 14:05:44 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-05197f53-5651-49dd-9bb5-6884e611e994-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-05197f53-5651-49dd-9bb5-6884e611e994-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Flow 'volume_create_manager' (78a98ff4-8690-4891-9353-48c0e3eaa9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cc1fa1-3fcc-43ae-841e-cb0e07abe047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cc1fa1-3fcc-43ae-841e-cb0e07abe047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1190286819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdea16fc-4635-465e-911e-4b2cf4d131df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57269cb552f04734a154434439e3c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:44Z,use_quota=True,user_id='9efcf1e1a34444cea1ea5645576a4e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb2615e-c0c8-4496-966e-67ace3991e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb2615e-c0c8-4496-966e-67ace3991e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14033cc7-a9ca-49a0-876a-245efe464383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14033cc7-a9ca-49a0-876a-245efe464383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdea16fc-4635-465e-911e-4b2cf4d131df', 'volume_name': 'volume-fdea16fc-4635-465e-911e-4b2cf4d131df', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb9a31c-d0dd-410b-bd11-7fb2707683a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb9a31c-d0dd-410b-bd11-7fb2707683a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e0558d-9476-4108-8d03-6e7dd84f5725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:44 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Volume fdea16fc-4635-465e-911e-4b2cf4d131df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdea16fc-4635-465e-911e-4b2cf4d131df', 'volume_size': 1} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1190286819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdea16fc-4635-465e-911e-4b2cf4d131df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57269cb552f04734a154434439e3c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:44Z,use_quota=True,user_id='9efcf1e1a34444cea1ea5645576a4e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Creating volume fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:44 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:44 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df 1073741824 Sep 25 14:05:44 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-05197f53-5651-49dd-9bb5-6884e611e994" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:44 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85.bfaf5021-a507-45bc-9bc7-5f83289fcfe1" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-05197f53-5651-49dd-9bb5-6884e611e994" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d5b1f5-971a-4f0e-8551-2bfabdcdfbf9]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-bfaf5021-a507-45bc-9bc7-5f83289fcfe1" released by "_delete_snapshot" :: held 2.776s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-85927bbc-502c-4e22-9bbf-99d5fcab4a85" released by "delete_snapshot" :: held 2.814s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Created reservations ['79902df4-535f-438c-ba8f-5c1f81eaadc8', 'bbc04a5b-c0ea-43a5-b0ce-ed775766de29', '0ec88aeb-50bd-44a5-8c73-374873681b68', 'd35ed72c-17d2-46dd-ad0d-b190626bf43c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:44 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 Sep 25 14:05:44 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-bff56ec4-8ce3-4e40-aceb-d99db64ae0b8 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-bfaf5021-a507-45bc-9bc7-5f83289fcfe1-delete_snapshot" released by "delete_snapshot" :: held 3.033s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:44 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df 1073741824" returned: 0 in 0.586s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:45 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df Sep 25 14:05:45 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-85927bbc-502c-4e22-9bbf-99d5fcab4a85-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-85927bbc-502c-4e22-9bbf-99d5fcab4a85-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-85927bbc-502c-4e22-9bbf-99d5fcab4a85" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-85927bbc-502c-4e22-9bbf-99d5fcab4a85" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:45 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994" returned: 0 in 0.699s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[267640fb-3dd6-4057-a801-3086defa195e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:45 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994 Sep 25 14:05:45 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:45 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 Sep 25 14:05:45 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:45 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df" returned: 0 in 0.414s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e0558d-9476-4108-8d03-6e7dd84f5725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdea16fc-4635-465e-911e-4b2cf4d131df', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c88c28-b62a-4901-8be9-ac2e01d94909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:45 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Volume volume-fdea16fc-4635-465e-911e-4b2cf4d131df (fdea16fc-4635-465e-911e-4b2cf4d131df): created successfully Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c88c28-b62a-4901-8be9-ac2e01d94909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Flow 'volume_create_manager' (78a98ff4-8690-4891-9353-48c0e3eaa9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f88f1523-3f4c-402e-b0a1-b664d3589ceb tempest-SnapshotDependencyTests-149169662 None] Created volume successfully. Sep 25 14:05:45 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-05197f53-5651-49dd-9bb5-6884e611e994" returned: 0 in 0.329s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-05197f53-5651-49dd-9bb5-6884e611e994" released by "delete_volume" :: held 1.123s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['b55f9e31-ef2f-4905-9593-824b985510da', '4a4ca8d6-e70f-4304-a42c-acbb37fbff6e', '9e1f9976-ef1f-48d7-8a4e-49b895f52eaa', '1b7ef99b-04ed-4342-a807-b058bde69d3e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:45 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85" returned: 0 in 0.506s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:45 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:45 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:45 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85 Sep 25 14:05:45 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:46 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.327s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:46 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleted volume successfully. Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-85927bbc-502c-4e22-9bbf-99d5fcab4a85" returned: 0 in 0.329s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-85927bbc-502c-4e22-9bbf-99d5fcab4a85" released by "delete_volume" :: held 0.942s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-05163299-83ab-4960-b9a2-35d8e81aac9f tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-05197f53-5651-49dd-9bb5-6884e611e994-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Created reservations ['0c113de0-63e7-40cf-a074-6483daf9de6d', '3195d81c-caaf-44b8-bb7e-5b0d733984db', 'b2d0aa91-7322-4163-947a-d902eb07500a', '06c1d6b9-4d30-4749-a7b3-7a02c6b85507'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:46 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:46 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:46 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.272s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-9760d63f-36a0-49d5-84cd-1e0bc3350f17-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-9760d63f-36a0-49d5-84cd-1e0bc3350f17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-b10e67db-d668-4077-974a-2ec89a7b9984" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-b97ac908-6326-4cb6-833d-4f0ad0e0577e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-85927bbc-502c-4e22-9bbf-99d5fcab4a85-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-b10e67db-d668-4077-974a-2ec89a7b9984" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-9760d63f-36a0-49d5-84cd-1e0bc3350f17" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-9760d63f-36a0-49d5-84cd-1e0bc3350f17" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleting offline snapshot 9760d63f-36a0-49d5-84cd-1e0bc3350f17 of volume b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] snapshot_file for this snap is: volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc7421-266d-4bcd-8794-a9b5d8eb40f1]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Creating offline snapshot 71fdd503-baa9-4433-9130-834c84086863 of volume fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed8c42f-bfb4-4880-a4f2-bb867738ddb5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:46 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 Sep 25 14:05:46 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:46 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df Sep 25 14:05:46 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:47 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17" returned: 0 in 0.376s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b10e67db-d668-4077-974a-2ec89a7b9984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8edb0-1fcd-4e6a-a9f2-7e63e91bba28]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:47 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df" returned: 0 in 0.421s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:47 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 1G Sep 25 14:05:47 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:47 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 Sep 25 14:05:47 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:47 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984" returned: 0 in 0.533s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:47 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 Sep 25 14:05:47 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:47 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 1G" returned: 0 in 0.762s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdea16fc-4635-465e-911e-4b2cf4d131df -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:48 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdea16fc-4635-465e-911e-4b2cf4d131df -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 Sep 25 14:05:48 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (0a031b30-aa7d-4516-a9d8-c45207867a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9871d6be-62d0-4b42-8c65-d85dcce67c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:48 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9871d6be-62d0-4b42-8c65-d85dcce67c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971184672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:48Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a8fc45-6a1a-4146-a316-0ac790f84adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a8fc45-6a1a-4146-a316-0ac790f84adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bbf48c-d855-460c-82fd-d8583807e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bbf48c-d855-460c-82fd-d8583807e34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16', 'volume_name': 'volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58106b2-3b45-4c31-b3f4-9a914ffc7579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58106b2-3b45-4c31-b3f4-9a914ffc7579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f660c2e-f6ff-49a7-ae50-235e6af689d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Volume 328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16', 'volume_size': 1} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17" returned: 0 in 0.600s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:48 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17 Sep 25 14:05:48 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:48 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdea16fc-4635-465e-911e-4b2cf4d131df -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:48 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 is being set with open permissions: ugo+rw Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:48 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 Sep 25 14:05:48 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:48 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984.9760d63f-36a0-49d5-84cd-1e0bc3350f17" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-9760d63f-36a0-49d5-84cd-1e0bc3350f17" released by "_delete_snapshot" :: held 1.935s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-b10e67db-d668-4077-974a-2ec89a7b9984" released by "delete_snapshot" :: held 1.962s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:48 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['74d48c77-7fd3-4f1c-a27d-70bc5e522ef2', 'f2330813-e52b-4158-b9d4-4a3243080b8e', 'a62484ce-e672-427a-8d83-37637f0a4c7f', '55a822b5-0a36-4a05-ab27-8ad7145d64cb'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863" returned: 0 in 0.290s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:48 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info Sep 25 14:05:48 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Delete snapshot completed successfully. Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-d96d4e99-499a-4463-b038-6b26c239725e tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-9760d63f-36a0-49d5-84cd-1e0bc3350f17-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-b10e67db-d668-4077-974a-2ec89a7b9984-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-b10e67db-d668-4077-974a-2ec89a7b9984-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "cinder-quobyte-b10e67db-d668-4077-974a-2ec89a7b9984" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-b10e67db-d668-4077-974a-2ec89a7b9984" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[56657ea6-30e8-4f28-a6a3-2c48c0297148]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:49 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 Sep 25 14:05:49 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:49 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info" returned: 0 in 0.392s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:49 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info is being set with open permissions: ugo+rw Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:49 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info Sep 25 14:05:49 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:49 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984" returned: 0 in 0.419s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:49 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984 Sep 25 14:05:49 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:49 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.info" returned: 0 in 0.380s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971184672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:48Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Creating volume 328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:49 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:49 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 1073741824 Sep 25 14:05:49 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:49 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4294de14-330e-43e7-8573-755689d7fbad tempest-SnapshotDependencyTests-149169662 None] Create snapshot completed successfully Sep 25 14:05:49 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-b10e67db-d668-4077-974a-2ec89a7b9984" returned: 0 in 0.359s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-quobyte-b10e67db-d668-4077-974a-2ec89a7b9984" released by "delete_volume" :: held 0.868s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Created reservations ['514e0a39-af26-473e-835c-56b7ba85ec4c', '1476fa96-3f62-45d3-a2ca-18f6cce47d48', 'd87f4f1e-0242-4c1e-9834-8898a500380a', '3828ef84-909d-45a9-a644-532dcd5dcf5f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:50 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:05:50 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:50 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 1073741824" returned: 0 in 0.752s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:50 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.423s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:05:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Deleted volume successfully. Sep 25 14:05:50 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 Sep 25 14:05:50 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9086e1c7-89a6-4c4b-ba8d-79837fe73c23 tempest-CreateVolumesFromSnapshotTest-1404899182 None] Lock "cinder-b10e67db-d668-4077-974a-2ec89a7b9984-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:05:50 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" returned: 0 in 0.440s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f660c2e-f6ff-49a7-ae50-235e6af689d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e234d09c-4778-4fbe-9160-6c21f42ab4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:50 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Volume volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 (328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16): created successfully Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e234d09c-4778-4fbe-9160-6c21f42ab4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:50 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (0a031b30-aa7d-4516-a9d8-c45207867a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ffa914a6-f6e9-47cb-af39-1175afce81d3 tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Flow 'volume_create_manager' (781167fd-3e88-4c6c-949c-bdcbf94bb536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb54dc8e-6285-48c1-865c-9c2dce5c7937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb54dc8e-6285-48c1-865c-9c2dce5c7937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9ed10f-5a62-46f7-af43-ca925f0ce573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57269cb552f04734a154434439e3c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=71fdd503-baa9-4433-9130-834c84086863,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:05:51Z,use_quota=True,user_id='9efcf1e1a34444cea1ea5645576a4e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89c1bb-f31c-41c1-85d7-9c0a2352a7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89c1bb-f31c-41c1-85d7-9c0a2352a7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caaee12-7bf3-4c63-b275-ee40c1159b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caaee12-7bf3-4c63-b275-ee40c1159b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e9ed10f-5a62-46f7-af43-ca925f0ce573', 'volume_name': 'volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573', 'volume_size': 1, 'snapshot_id': '71fdd503-baa9-4433-9130-834c84086863'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79137a2f-bedf-4e42-ac40-92eee1f2e92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79137a2f-bedf-4e42-ac40-92eee1f2e92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fae8ec-c32c-4fbc-8c4b-2be5c86db8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:05:51 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Volume 4e9ed10f-5a62-46f7-af43-ca925f0ce573: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573', 'volume_size': 1, 'snapshot_id': '71fdd503-baa9-4433-9130-834c84086863'} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-quobyte-71fdd503-baa9-4433-9130-834c84086863-4e9ed10f-5a62-46f7-af43-ca925f0ce573" by "_create_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-71fdd503-baa9-4433-9130-834c84086863-4e9ed10f-5a62-46f7-af43-ca925f0ce573" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Creating volume 4e9ed10f-5a62-46f7-af43-ca925f0ce573 from snapshot 71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-quobyte-4e9ed10f-5a62-46f7-af43-ca925f0ce573" by "_copy_volume_from_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-4e9ed10f-5a62-46f7-af43-ca925f0ce573" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] snapshot: 71fdd503-baa9-4433-9130-834c84086863, volume: 4e9ed10f-5a62-46f7-af43-ca925f0ce573, {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a6170-c511-4547-850d-eb825ca6a96a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:51 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 Sep 25 14:05:51 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:05:51 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863" returned: 0 in 0.420s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdea16fc-4635-465e-911e-4b2cf4d131df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e1d2a8-1cad-4041-93a7-3bb7896aca40]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:05:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:51 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df Sep 25 14:05:51 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:05:52 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 25 14:05:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df" returned: 0 in 0.456s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:05:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 14:05:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Creating direct copy from snapshot {{(pid=87220) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 14:05:52 devstack cinder-volume[87220]: DEBUG cinder.utils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Path /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 not found in is_blk_device check {{(pid=87220) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 14:05:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:05:52 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 Sep 25 14:05:52 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:00 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573" returned: 0 in 8.349s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG cinder.image.image_utils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 {{(pid=87220) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 14:06:00 devstack cinder-volume[87220]: INFO cinder.image.image_utils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Converted 1024.00 MB image at 122.62 MB/s Sep 25 14:06:00 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 is being set with open permissions: ugo+rw Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:00 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 Sep 25 14:06:00 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:00 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-4e9ed10f-5a62-46f7-af43-ca925f0ce573" released by "_copy_volume_from_snapshot" :: held 9.617s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-71fdd503-baa9-4433-9130-834c84086863-4e9ed10f-5a62-46f7-af43-ca925f0ce573" released by "_create_volume_from_snapshot" :: held 9.702s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.718s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.461s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot 6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 of volume 328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fae8ec-c32c-4fbc-8c4b-2be5c86db8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573', 'volume_size': 1, 'snapshot_id': '71fdd503-baa9-4433-9130-834c84086863'}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9b6b5c-d77b-48fb-8cc2-7589ca81f2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4297c8ae-91f3-48eb-9e2d-c72e7293b511]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:01 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Volume volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 (4e9ed10f-5a62-46f7-af43-ca925f0ce573): created successfully Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9b6b5c-d77b-48fb-8cc2-7589ca81f2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:01 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 Sep 25 14:06:01 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Flow 'volume_create_manager' (781167fd-3e88-4c6c-949c-bdcbf94bb536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-29729d67-9c79-4ebd-a809-cf4566f1575f tempest-SnapshotDependencyTests-149169662 None] Created volume successfully. Sep 25 14:06:01 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" returned: 0 in 0.486s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:01 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 1G Sep 25 14:06:01 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:02 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 1G" returned: 0 in 0.602s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:02 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 Sep 25 14:06:02 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-71fdd503-baa9-4433-9130-834c84086863-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:02 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" returned: 0 in 0.401s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:02 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 is being set with open permissions: ugo+rw Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-71fdd503-baa9-4433-9130-834c84086863-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-quobyte-fdea16fc-4635-465e-911e-4b2cf4d131df" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:02 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 Sep 25 14:06:02 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-fdea16fc-4635-465e-911e-4b2cf4d131df" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-quobyte-71fdd503-baa9-4433-9130-834c84086863" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-71fdd503-baa9-4433-9130-834c84086863" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Deleting offline snapshot 71fdd503-baa9-4433-9130-834c84086863 of volume fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] snapshot_file for this snap is: volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2000f2-a8fc-46b8-b4d4-9377c000eade]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:02 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 Sep 25 14:06:02 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:02 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" returned: 0 in 0.326s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:02 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info Sep 25 14:06:02 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:03 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863" returned: 0 in 0.482s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdea16fc-4635-465e-911e-4b2cf4d131df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dd50d2-66f7-410f-9fca-2c5c9a350895]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:03 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info" returned: 0 in 0.300s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:03 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info is being set with open permissions: ugo+rw Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:03 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info Sep 25 14:06:03 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:03 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df Sep 25 14:06:03 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:03 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.info" returned: 0 in 0.302s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-86df995b-6315-4b8c-8728-13590ebab305 tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:03 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df" returned: 0 in 0.715s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:03 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 Sep 25 14:06:03 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:04 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-6a9345fb-7e1c-4c58-8d8b-63c26fac2f36-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863" returned: 0 in 0.480s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-6a9345fb-7e1c-4c58-8d8b-63c26fac2f36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:04 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863 Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:04 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot 6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 of volume 328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b465a356-a175-4071-92d9-25a2a189fee0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:04 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 Sep 25 14:06:04 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:04 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df.71fdd503-baa9-4433-9130-834c84086863" returned: 0 in 0.341s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-71fdd503-baa9-4433-9130-834c84086863" released by "_delete_snapshot" :: held 2.187s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-fdea16fc-4635-465e-911e-4b2cf4d131df" released by "delete_snapshot" :: held 2.222s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:04 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Created reservations ['5d8d64e3-cf9c-4c73-9032-848b27377e42', '5df0b66c-41c1-46eb-a711-5cc6126f1bf6', 'd7fbe8db-a550-4c08-a935-4c8d652e5c4f', '10f490e5-8ab6-4502-bde9-c2485e26783d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Delete snapshot completed successfully. Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-2086a5aa-54af-440d-9993-03a82c9bf7db tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-71fdd503-baa9-4433-9130-834c84086863-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:05 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" returned: 0 in 0.562s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29280ca-36c2-4207-9c20-5bc4369ea1f3]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:05 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 Sep 25 14:06:05 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:05 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" returned: 0 in 0.435s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:05 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 Sep 25 14:06:05 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-fdea16fc-4635-465e-911e-4b2cf4d131df-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:05 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-fdea16fc-4635-465e-911e-4b2cf4d131df-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-quobyte-fdea16fc-4635-465e-911e-4b2cf4d131df" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-fdea16fc-4635-465e-911e-4b2cf4d131df" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:06 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" returned: 0 in 0.603s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dbfbde-a896-4677-bdae-3e2f4bfe0803]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:06 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36 Sep 25 14:06:06 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:06 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df Sep 25 14:06:06 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:06 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16.6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" returned: 0 in 0.359s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-6a9345fb-7e1c-4c58-8d8b-63c26fac2f36" released by "_delete_snapshot" :: held 2.119s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" released by "delete_snapshot" :: held 2.155s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:06 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Created reservations ['80bb57db-a194-4572-b2ff-225caef6f5d6', '9f3393f4-923f-4e2a-aa31-6ee5df67444b', 'f930d086-c34e-4597-8666-6a8b0d8ac425', '7cfdca6d-5090-46c5-add3-96779dd2013e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df" returned: 0 in 0.530s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:06 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df Sep 25 14:06:06 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:06 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ea6e7cbf-753d-43d6-bfcd-c6d3ac22424d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-6a9345fb-7e1c-4c58-8d8b-63c26fac2f36-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:07 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-fdea16fc-4635-465e-911e-4b2cf4d131df" returned: 0 in 0.346s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-fdea16fc-4635-465e-911e-4b2cf4d131df" released by "delete_volume" :: held 0.988s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Created reservations ['cd4e8f6b-bdfb-4301-9c3a-e3a7fe2d92cc', '7b083b75-7c4a-4329-b288-4186c5bb1e5c', '148bf560-3f3f-4cf7-afcc-a9f50a4bc849', '93d47827-bbc0-472f-928f-d54c27556134'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:07 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:07 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:07 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.337s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:07 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Deleted volume successfully. Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-053e703b-83ae-4d9d-8b22-4de7f23532ce tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-fdea16fc-4635-465e-911e-4b2cf4d131df-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" acquired by "delete_volume" :: waited 0.040s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be7adeb-3724-43bb-b76c-4ea8dcb2f6f7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:08 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 Sep 25 14:06:08 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-4e9ed10f-5a62-46f7-af43-ca925f0ce573-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-4e9ed10f-5a62-46f7-af43-ca925f0ce573-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "cinder-quobyte-4e9ed10f-5a62-46f7-af43-ca925f0ce573" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-4e9ed10f-5a62-46f7-af43-ca925f0ce573" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be00f3d-9fe3-4a3c-acb6-2a81cdf7d50e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:08 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" returned: 0 in 0.540s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:08 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16 Sep 25 14:06:08 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:08 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 Sep 25 14:06:08 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:08 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" returned: 0 in 0.335s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16" released by "delete_volume" :: held 0.987s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:08 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Created reservations ['b1866549-9130-439d-9858-003b4b08b81e', '901e0bc0-cb48-4ed6-8e5b-c4c77927ddfa', 'aab8207a-50c1-4c9f-9d7a-8e901976deea', 'f1b71ece-2b0f-4570-bc10-8ab489256819'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:09 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573" returned: 0 in 0.581s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:09 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573 Sep 25 14:06:09 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:09 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:09 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (cf1556dc-8252-4ba2-b158-152e62e8ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:09 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d35859-f908-40e4-8bfb-7673b7513abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-4e9ed10f-5a62-46f7-af43-ca925f0ce573" returned: 0 in 0.511s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d35859-f908-40e4-8bfb-7673b7513abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-687218900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31af215-164d-409b-9d44-da3e1e0434ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:09Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecae6a9-437f-48fd-a50d-6c519a762695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecae6a9-437f-48fd-a50d-6c519a762695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb04122-bfae-464a-96f7-b9ef63f0b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb04122-bfae-464a-96f7-b9ef63f0b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31af215-164d-409b-9d44-da3e1e0434ec', 'volume_name': 'volume-d31af215-164d-409b-9d44-da3e1e0434ec', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b173608b-fbdc-4e88-938b-a70bf3052c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b173608b-fbdc-4e88-938b-a70bf3052c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fce7edf-2ae9-4eab-9a3c-1665784c761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:09 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Volume d31af215-164d-409b-9d44-da3e1e0434ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31af215-164d-409b-9d44-da3e1e0434ec', 'volume_size': 1} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-687218900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31af215-164d-409b-9d44-da3e1e0434ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:09Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Creating volume d31af215-164d-409b-9d44-da3e1e0434ec {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:09 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-quobyte-4e9ed10f-5a62-46f7-af43-ca925f0ce573" released by "delete_volume" :: held 1.238s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:09 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.449s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:09 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec 1073741824 Sep 25 14:06:09 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:09 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-cde38c29-46c0-49cb-beff-6fcbbf9a98e6 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-328cd2d8-2de2-4c24-b9f1-fa1ff23b9e16-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Created reservations ['21636a4b-1571-4a2c-87de-cbdb76b9898f', 'd1420641-1e2e-4043-a86d-2ecf546b2e88', '612207e9-4e34-4416-9861-7810ba81c44e', 'dd10eba1-01b5-4b07-8c67-888e4c5c604c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:09 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:09 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:10 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:10 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:10 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.315s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Deleted volume successfully. Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-832e5ee4-684e-4b97-b98d-454de0c31b2c tempest-SnapshotDependencyTests-149169662 None] Lock "cinder-4e9ed10f-5a62-46f7-af43-ca925f0ce573-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:10 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec 1073741824" returned: 0 in 0.658s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:10 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec Sep 25 14:06:10 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:10 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.388s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:06:10 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec" returned: 0 in 0.430s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fce7edf-2ae9-4eab-9a3c-1665784c761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31af215-164d-409b-9d44-da3e1e0434ec', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d30a89d-aa80-4b5c-909e-c4636f819f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:10 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Volume volume-d31af215-164d-409b-9d44-da3e1e0434ec (d31af215-164d-409b-9d44-da3e1e0434ec): created successfully Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d30a89d-aa80-4b5c-909e-c4636f819f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (cf1556dc-8252-4ba2-b158-152e62e8ba16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c5b89a5e-bbdc-45d2-8965-75c8addec489 tempest-ProjectReaderTests-2083114769 None] Created volume successfully. Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (a566d5b4-e452-4dfe-aff2-44cc6dfa9539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536e4611-5a35-4f75-a6ee-a70b6cca453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536e4611-5a35-4f75-a6ee-a70b6cca453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732374010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a12b64-6846-40f0-b6ab-fe59630d2417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:11Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c01632-b93b-4ece-aee8-6a7a4fae20b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c01632-b93b-4ece-aee8-6a7a4fae20b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b354d5b-e527-421a-87d1-2a03c9af973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b354d5b-e527-421a-87d1-2a03c9af973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a12b64-6846-40f0-b6ab-fe59630d2417', 'volume_name': 'volume-46a12b64-6846-40f0-b6ab-fe59630d2417', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0f63d7-9ef4-49ba-9304-2aeccfc9295b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0f63d7-9ef4-49ba-9304-2aeccfc9295b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4933acfd-31f3-436e-88e3-b967d79f7aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:11 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Volume 46a12b64-6846-40f0-b6ab-fe59630d2417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a12b64-6846-40f0-b6ab-fe59630d2417', 'volume_size': 1} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732374010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a12b64-6846-40f0-b6ab-fe59630d2417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:11Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Creating volume 46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:11 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:11 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 1073741824 Sep 25 14:06:11 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-d31af215-164d-409b-9d44-da3e1e0434ec-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:11 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 1073741824" returned: 0 in 0.763s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-d31af215-164d-409b-9d44-da3e1e0434ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:11 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-quobyte-d31af215-164d-409b-9d44-da3e1e0434ec" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-d31af215-164d-409b-9d44-da3e1e0434ec" acquired by "delete_volume" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:12 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 Sep 25 14:06:12 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010a419-34ec-4b59-ab8b-616995521ade]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:12 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec Sep 25 14:06:12 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:12 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417" returned: 0 in 0.548s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4933acfd-31f3-436e-88e3-b967d79f7aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a12b64-6846-40f0-b6ab-fe59630d2417', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64429c82-bbc8-4cae-b3f5-8d6808d6e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:12 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Volume volume-46a12b64-6846-40f0-b6ab-fe59630d2417 (46a12b64-6846-40f0-b6ab-fe59630d2417): created successfully Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64429c82-bbc8-4cae-b3f5-8d6808d6e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (a566d5b4-e452-4dfe-aff2-44cc6dfa9539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:12 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d6590b1a-8df6-4e14-964e-450403b98317 tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:06:12 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec" returned: 0 in 0.644s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:12 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:12 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec Sep 25 14:06:12 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:13 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d31af215-164d-409b-9d44-da3e1e0434ec" returned: 0 in 0.312s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-d31af215-164d-409b-9d44-da3e1e0434ec" released by "delete_volume" :: held 1.032s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Created reservations ['0dc7d00b-a1cd-47df-a1c8-e6798b150df5', 'd3bbdf5a-2d58-49ca-bd51-c15b848df411', 'd94e2fdb-c3f8-4754-b483-21ea866746c2', '491f0294-375b-4819-913a-d0d569277d5f'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot 0070eb7b-7550-40ff-a225-d777308f687a of volume 46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4180303-50c4-4acf-ba3f-107c17b1ebd8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:13 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:13 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:13 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 Sep 25 14:06:13 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:13 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.364s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:13 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Deleted volume successfully. Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0bb0a647-3689-4168-b29a-19a8d8d77f08 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-d31af215-164d-409b-9d44-da3e1e0434ec-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:13 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417" returned: 0 in 0.521s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:13 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a 1G Sep 25 14:06:13 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:14 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a 1G" returned: 0 in 0.658s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a12b64-6846-40f0-b6ab-fe59630d2417 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:14 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a12b64-6846-40f0-b6ab-fe59630d2417 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a Sep 25 14:06:14 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (8f60c4d6-c015-436b-a2ca-130044b079c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:15 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18afa7a8-d104-4412-99a7-f9a018b090f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a12b64-6846-40f0-b6ab-fe59630d2417 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a" returned: 0 in 0.523s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:15 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a is being set with open permissions: ugo+rw Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:15 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a Sep 25 14:06:15 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18afa7a8-d104-4412-99a7-f9a018b090f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352178294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7346004c-2177-49f8-80cd-a602a10d60f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:15Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3686ab-9f60-4314-8626-61a98ec589aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3686ab-9f60-4314-8626-61a98ec589aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd6d2b2-f317-4d4f-9c25-fb1c99db847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd6d2b2-f317-4d4f-9c25-fb1c99db847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7346004c-2177-49f8-80cd-a602a10d60f0', 'volume_name': 'volume-7346004c-2177-49f8-80cd-a602a10d60f0', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54418c47-1ca2-40e0-99bf-64d8ad4f4f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54418c47-1ca2-40e0-99bf-64d8ad4f4f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6075297f-7c5f-4f86-869f-f8e7f8647eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Volume 7346004c-2177-49f8-80cd-a602a10d60f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7346004c-2177-49f8-80cd-a602a10d60f0', 'volume_size': 1} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:15 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a" returned: 0 in 0.310s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:15 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info Sep 25 14:06:15 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:15 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info" returned: 0 in 0.308s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:15 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info is being set with open permissions: ugo+rw Sep 25 14:06:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:15 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info Sep 25 14:06:15 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:16 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.info" returned: 0 in 0.375s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352178294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7346004c-2177-49f8-80cd-a602a10d60f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:15Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Creating volume 7346004c-2177-49f8-80cd-a602a10d60f0 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:16 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:16 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 1073741824 Sep 25 14:06:16 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c386ba7d-6d7a-41e8-a40c-cfedb15d9985 tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-0070eb7b-7550-40ff-a225-d777308f687a-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-0070eb7b-7550-40ff-a225-d777308f687a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-46a12b64-6846-40f0-b6ab-fe59630d2417" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-46a12b64-6846-40f0-b6ab-fe59630d2417" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-0070eb7b-7550-40ff-a225-d777308f687a" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-0070eb7b-7550-40ff-a225-d777308f687a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot 0070eb7b-7550-40ff-a225-d777308f687a of volume 46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1466c76d-f0d5-42a3-9e1f-9bcbe26abce6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:16 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 1073741824" returned: 0 in 0.667s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:16 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a Sep 25 14:06:16 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:17 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 Sep 25 14:06:17 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:17 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a" returned: 0 in 0.543s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46a12b64-6846-40f0-b6ab-fe59630d2417(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336a037-1236-4f93-8dad-a605518883e7]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:17 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0" returned: 0 in 0.527s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6075297f-7c5f-4f86-869f-f8e7f8647eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7346004c-2177-49f8-80cd-a602a10d60f0', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c421655-7889-4112-9eae-06a8e6b2a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:17 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Volume volume-7346004c-2177-49f8-80cd-a602a10d60f0 (7346004c-2177-49f8-80cd-a602a10d60f0): created successfully Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c421655-7889-4112-9eae-06a8e6b2a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (8f60c4d6-c015-436b-a2ca-130044b079c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:17 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 Sep 25 14:06:17 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-da786dc8-69e1-4071-b69a-8041901f499a tempest-ProjectReaderTests-2083114769 None] Created volume successfully. Sep 25 14:06:18 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417" returned: 0 in 0.711s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:18 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a Sep 25 14:06:18 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-7346004c-2177-49f8-80cd-a602a10d60f0-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-7346004c-2177-49f8-80cd-a602a10d60f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-quobyte-7346004c-2177-49f8-80cd-a602a10d60f0" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-7346004c-2177-49f8-80cd-a602a10d60f0" acquired by "delete_volume" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad51b96-fc36-4fc6-9391-5ce474c59191]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:18 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a" returned: 0 in 0.568s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:18 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a Sep 25 14:06:18 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:18 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 Sep 25 14:06:18 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:19 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417.0070eb7b-7550-40ff-a225-d777308f687a" returned: 0 in 0.435s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-0070eb7b-7550-40ff-a225-d777308f687a" released by "_delete_snapshot" :: held 2.444s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:19 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-46a12b64-6846-40f0-b6ab-fe59630d2417" released by "delete_snapshot" :: held 2.482s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0" returned: 0 in 0.637s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:19 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0 Sep 25 14:06:19 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Created reservations ['1077b90e-a425-4034-8a9c-4209b989eb78', '1a2c8159-7876-4697-96c6-ff68763f00b1', '4d57da2f-ce8d-4d0e-b7d1-808d7b0264f2', '2b03f36e-7dca-4f86-9cda-42ee27322573'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-aa26fd56-c8d5-496c-866c-b13cc9908f65 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-0070eb7b-7550-40ff-a225-d777308f687a-delete_snapshot" released by "delete_snapshot" :: held 2.777s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:19 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7346004c-2177-49f8-80cd-a602a10d60f0" returned: 0 in 0.415s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-7346004c-2177-49f8-80cd-a602a10d60f0" released by "delete_volume" :: held 1.115s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Created reservations ['3af7c896-2a24-4ca2-8f3f-ea56dd7e8136', 'e2e159bf-af73-4aa8-9d56-29c721e2f4c5', '529951c7-89f7-4496-8ca2-db1b56e9ccac', 'd51dc9d5-1f76-4f54-ab45-ca0b7d7f88f7'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:19 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:19 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-46a12b64-6846-40f0-b6ab-fe59630d2417-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-46a12b64-6846-40f0-b6ab-fe59630d2417-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-46a12b64-6846-40f0-b6ab-fe59630d2417" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-46a12b64-6846-40f0-b6ab-fe59630d2417" acquired by "delete_volume" :: waited 0.033s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:20 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.443s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Deleted volume successfully. Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b8239b-f527-4e93-924b-1afa8f88ba33]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-7d85ee2a-06a5-45f5-bec2-ddcfc4334dd0 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-7346004c-2177-49f8-80cd-a602a10d60f0-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:20 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 Sep 25 14:06:20 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:20 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417" returned: 0 in 0.487s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:20 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417 Sep 25 14:06:20 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:21 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-46a12b64-6846-40f0-b6ab-fe59630d2417" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-46a12b64-6846-40f0-b6ab-fe59630d2417" released by "delete_volume" :: held 0.987s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Created reservations ['e70e31f2-af32-4974-a59f-fa42731948b0', '2128d93f-79db-4e9f-b46d-d5b713995a35', '071009d4-7f56-4a6d-b00c-7c080a64c8c0', '48249e5b-fd51-4d87-b121-ad002b855990'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:21 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:21 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (b0930e69-0037-474c-a1ea-3290093185bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922dea46-e6a0-48c3-a71a-e25a023172ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922dea46-e6a0-48c3-a71a-e25a023172ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842511293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882dd9ad-f81e-4687-adb3-9f8488798505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:21Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99723f4-5574-49f2-9ff8-b203701c632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99723f4-5574-49f2-9ff8-b203701c632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d245a135-ea7c-4b1e-87cb-4aabd0e7933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d245a135-ea7c-4b1e-87cb-4aabd0e7933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882dd9ad-f81e-4687-adb3-9f8488798505', 'volume_name': 'volume-882dd9ad-f81e-4687-adb3-9f8488798505', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451038ac-0cdb-4dcc-9842-242936db62d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451038ac-0cdb-4dcc-9842-242936db62d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ae87dc-a62c-41a2-a808-7be51d009b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:21 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Volume 882dd9ad-f81e-4687-adb3-9f8488798505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882dd9ad-f81e-4687-adb3-9f8488798505', 'volume_size': 1} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842511293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882dd9ad-f81e-4687-adb3-9f8488798505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:21Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Creating volume 882dd9ad-f81e-4687-adb3-9f8488798505 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:21 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:21 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 1073741824 Sep 25 14:06:21 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:21 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.388s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:06:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-38c2d25c-dd14-41a4-9661-216cf7c0f248 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-46a12b64-6846-40f0-b6ab-fe59630d2417-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:22 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 1073741824" returned: 0 in 0.549s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:22 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 Sep 25 14:06:22 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:22 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505" returned: 0 in 0.350s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ae87dc-a62c-41a2-a808-7be51d009b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882dd9ad-f81e-4687-adb3-9f8488798505', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5855b39d-07e8-43d9-b508-642bd42db757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Volume volume-882dd9ad-f81e-4687-adb3-9f8488798505 (882dd9ad-f81e-4687-adb3-9f8488798505): created successfully Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5855b39d-07e8-43d9-b508-642bd42db757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (b0930e69-0037-474c-a1ea-3290093185bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:22 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-3b5dfaf9-7ee0-4d83-a762-5657e2856447 tempest-ProjectReaderTests-2083114769 None] Created volume successfully. Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (72236b2b-e527-44bd-a7d1-1281779d95c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189583f3-2f32-4e64-8f30-bb2f665a6cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189583f3-2f32-4e64-8f30-bb2f665a6cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807953514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a78939e-75ac-4184-ab8e-d7514b77ab49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:23Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746e75bc-41bc-4bfa-bc6f-2a2542bc206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746e75bc-41bc-4bfa-bc6f-2a2542bc206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8ca8d6-9cc3-46b6-9c6f-7822bd4add8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8ca8d6-9cc3-46b6-9c6f-7822bd4add8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a78939e-75ac-4184-ab8e-d7514b77ab49', 'volume_name': 'volume-7a78939e-75ac-4184-ab8e-d7514b77ab49', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6d4eb7-e554-451e-a5fe-37845f109ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6d4eb7-e554-451e-a5fe-37845f109ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bc4d14-bc3e-4162-a59d-03ebb1caf88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:23 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Volume 7a78939e-75ac-4184-ab8e-d7514b77ab49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a78939e-75ac-4184-ab8e-d7514b77ab49', 'volume_size': 1} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807953514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a78939e-75ac-4184-ab8e-d7514b77ab49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:23Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Creating volume 7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:23 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:23 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 1073741824 Sep 25 14:06:23 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:23 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 1073741824" returned: 0 in 0.535s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-882dd9ad-f81e-4687-adb3-9f8488798505-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:23 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 Sep 25 14:06:23 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-882dd9ad-f81e-4687-adb3-9f8488798505-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-quobyte-882dd9ad-f81e-4687-adb3-9f8488798505" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-882dd9ad-f81e-4687-adb3-9f8488798505" acquired by "delete_volume" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c627b14b-46af-49b8-9cd4-7cf74baa07e8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:24 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:24 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 Sep 25 14:06:24 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bc4d14-bc3e-4162-a59d-03ebb1caf88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a78939e-75ac-4184-ab8e-d7514b77ab49', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a435993d-073c-45cb-a460-7c60051026c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:24 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Volume volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 (7a78939e-75ac-4184-ab8e-d7514b77ab49): created successfully Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a435993d-073c-45cb-a460-7c60051026c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (72236b2b-e527-44bd-a7d1-1281779d95c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:24 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a2e0dccc-c3aa-41c2-a773-aecea868eeac tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:06:24 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505" returned: 0 in 0.561s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:24 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505 Sep 25 14:06:24 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:24 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-882dd9ad-f81e-4687-adb3-9f8488798505" returned: 0 in 0.289s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-882dd9ad-f81e-4687-adb3-9f8488798505" released by "delete_volume" :: held 0.914s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Created reservations ['07a4ce09-5f12-4b3c-a8a4-210fb9ebee14', '8df57879-eb95-4322-ab7c-1c1b56f964a7', 'd1fcec76-bea5-4d85-a63b-f00ebbd356a2', 'e1915d93-79a1-4ee0-9701-33f09a20ca54'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:24 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:24 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:25 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:25 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Deleted volume successfully. Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-0752d208-feda-4e6d-bb62-d96b476b4a15 tempest-ProjectReaderTests-2083114769 None] Lock "cinder-882dd9ad-f81e-4687-adb3-9f8488798505-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot bdec2869-6311-43dd-9824-0054593c077b of volume 7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[8670ad42-1652-405c-8e20-c7d59bb8f914]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (bd3ae6bb-640a-4f38-a04a-f823e206a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa77982-f2cd-47d8-8aa3-d04a1a5f45d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa77982-f2cd-47d8-8aa3-d04a1a5f45d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144269942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb37badf-1140-4f48-bc91-631f02f306c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:26Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202dd0d2-c3bc-4e56-b5da-8e02eea297e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202dd0d2-c3bc-4e56-b5da-8e02eea297e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e82c4d3-3e29-490d-a57b-ffa42b7de043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e82c4d3-3e29-490d-a57b-ffa42b7de043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb37badf-1140-4f48-bc91-631f02f306c1', 'volume_name': 'volume-bb37badf-1140-4f48-bc91-631f02f306c1', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63c5d5d-5afb-4025-bf79-5c0e292c8b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:25 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63c5d5d-5afb-4025-bf79-5c0e292c8b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:25 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c4c73d-3833-4413-add2-0adae5da3c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:25 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Volume bb37badf-1140-4f48-bc91-631f02f306c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb37badf-1140-4f48-bc91-631f02f306c1', 'volume_size': 1} Sep 25 14:06:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:26 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49" returned: 0 in 0.449s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:26 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b 1G Sep 25 14:06:26 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:26 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b 1G" returned: 0 in 0.480s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:26 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b Sep 25 14:06:26 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:26 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b" returned: 0 in 0.284s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:26 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b is being set with open permissions: ugo+rw Sep 25 14:06:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:26 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b Sep 25 14:06:26 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:27 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b" returned: 0 in 0.244s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:27 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info Sep 25 14:06:27 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:27 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info" returned: 0 in 0.256s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:27 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info is being set with open permissions: ugo+rw Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:27 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info Sep 25 14:06:27 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:27 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.info" returned: 0 in 0.278s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144269942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb37badf-1140-4f48-bc91-631f02f306c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3819f2a894316816f57520aeae695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:26Z,use_quota=True,user_id='90e543c6bcb84d369ba2523a673474d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Creating volume bb37badf-1140-4f48-bc91-631f02f306c1 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:27 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:27 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 1073741824 Sep 25 14:06:27 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:27 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-de6eb2b2-375b-493c-b974-9f6b3af291ed tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:28 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 1073741824" returned: 0 in 0.462s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:28 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 Sep 25 14:06:28 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-bdec2869-6311-43dd-9824-0054593c077b-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:28 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1" returned: 0 in 0.276s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-bdec2869-6311-43dd-9824-0054593c077b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-7a78939e-75ac-4184-ab8e-d7514b77ab49" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c4c73d-3833-4413-add2-0adae5da3c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb37badf-1140-4f48-bc91-631f02f306c1', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7471d71a-5918-4b67-a556-c21a47e2f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-7a78939e-75ac-4184-ab8e-d7514b77ab49" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-bdec2869-6311-43dd-9824-0054593c077b" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:28 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Volume volume-bb37badf-1140-4f48-bc91-631f02f306c1 (bb37badf-1140-4f48-bc91-631f02f306c1): created successfully Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7471d71a-5918-4b67-a556-c21a47e2f925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Flow 'volume_create_manager' (bd3ae6bb-640a-4f38-a04a-f823e206a072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-bdec2869-6311-43dd-9824-0054593c077b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot bdec2869-6311-43dd-9824-0054593c077b of volume 7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:28 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-72d25932-6b39-44eb-b1ca-fbe9640610a3 tempest-ProjectReaderTests-2083114769 None] Created volume successfully. Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[508a9cca-210b-4f5e-8167-92e7d3fe92d5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:28 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b Sep 25 14:06:28 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:28 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b" returned: 0 in 0.349s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a78939e-75ac-4184-ab8e-d7514b77ab49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2fc33c-648b-4780-a4e3-728de7e11623]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:29 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 Sep 25 14:06:29 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:29 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49" returned: 0 in 0.379s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:29 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b Sep 25 14:06:29 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-bb37badf-1140-4f48-bc91-631f02f306c1-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Lock "cinder-bb37badf-1140-4f48-bc91-631f02f306c1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:29 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b" returned: 0 in 0.395s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:29 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b Sep 25 14:06:29 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Acquiring lock "cinder-quobyte-bb37badf-1140-4f48-bc91-631f02f306c1" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-bb37badf-1140-4f48-bc91-631f02f306c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[667409f7-ed75-437d-a964-d8d75162e047]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:30 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 Sep 25 14:06:30 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:30 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49.bdec2869-6311-43dd-9824-0054593c077b" returned: 0 in 0.282s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-bdec2869-6311-43dd-9824-0054593c077b" released by "_delete_snapshot" :: held 1.514s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-7a78939e-75ac-4184-ab8e-d7514b77ab49" released by "delete_snapshot" :: held 1.561s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Created reservations ['ce316be2-9e30-4db2-bbdc-e8128942ac6e', 'ce6c5a0c-8063-4f36-bde8-effa88df64e7', 'f02057a1-dc2b-4f26-a09b-a666de3a4fd3', '15dad234-5e97-4536-9e86-c2e2a20ebbb2'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:30 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-692625ce-2b64-4900-be0f-1db10039730e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-bdec2869-6311-43dd-9824-0054593c077b-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:30 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1" returned: 0 in 0.447s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:30 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1 Sep 25 14:06:30 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:30 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bb37badf-1140-4f48-bc91-631f02f306c1" returned: 0 in 0.243s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Lock "cinder-quobyte-bb37badf-1140-4f48-bc91-631f02f306c1" released by "delete_volume" :: held 0.740s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Created reservations ['5a3d87b9-b46d-4435-b8c7-c393e4cd5308', 'b35b3614-d03b-4997-8bfc-e2c5329dce36', '1052a210-1174-4d5f-b44a-d71efcb18aff', '2727d13f-8ec1-46b1-b7da-8ca764711662'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-7a78939e-75ac-4184-ab8e-d7514b77ab49-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-7a78939e-75ac-4184-ab8e-d7514b77ab49-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-7a78939e-75ac-4184-ab8e-d7514b77ab49" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-7a78939e-75ac-4184-ab8e-d7514b77ab49" acquired by "delete_volume" :: waited 0.047s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:30 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:30 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f762d-983d-42e2-8991-383ce91c5908]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:31 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 Sep 25 14:06:31 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:31 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.317s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Deleted volume successfully. Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9db89dd3-a621-4e57-855b-c2d85f64d65b tempest-ProjectReaderTests-2083114769 None] Lock "cinder-bb37badf-1140-4f48-bc91-631f02f306c1-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:31 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49" returned: 0 in 0.461s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:31 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49 Sep 25 14:06:31 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:31 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a78939e-75ac-4184-ab8e-d7514b77ab49" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-7a78939e-75ac-4184-ab8e-d7514b77ab49" released by "delete_volume" :: held 0.854s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Created reservations ['1237464c-ccf2-4404-8bec-aac6f12c03a1', 'b62a782e-9d7c-4c33-a2cd-d59ee042a9e3', 'ade8f6e1-3dc4-4224-a0ee-f1b58d64163d', '80c568f6-0b59-4359-9b0a-222082464802'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:31 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:31 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:32 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.281s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-f7bbe481-6902-426e-a721-a667a100477e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-7a78939e-75ac-4184-ab8e-d7514b77ab49-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (a7083e4e-6757-47ca-9254-e7c422e943a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3c08e1-62fe-43a6-89bc-8e8792c4da5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3c08e1-62fe-43a6-89bc-8e8792c4da5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430552627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cff0ad-713d-4b9f-a17c-a778967284e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:32Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662ca81d-b72a-4712-88a6-dd6f7107dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662ca81d-b72a-4712-88a6-dd6f7107dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38beb20-21c6-4c2f-877d-ca478d2315d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38beb20-21c6-4c2f-877d-ca478d2315d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cff0ad-713d-4b9f-a17c-a778967284e3', 'volume_name': 'volume-a3cff0ad-713d-4b9f-a17c-a778967284e3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5d45af-b5f6-4623-b37a-eb64d8fc4c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5d45af-b5f6-4623-b37a-eb64d8fc4c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224998b2-327e-44a0-85cd-ab16c4fb07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Volume a3cff0ad-713d-4b9f-a17c-a778967284e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cff0ad-713d-4b9f-a17c-a778967284e3', 'volume_size': 1} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430552627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cff0ad-713d-4b9f-a17c-a778967284e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:32Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Creating volume a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:32 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:32 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 1073741824 Sep 25 14:06:32 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:33 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 1073741824" returned: 0 in 0.483s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:33 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 Sep 25 14:06:33 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:33 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3" returned: 0 in 0.265s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224998b2-327e-44a0-85cd-ab16c4fb07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cff0ad-713d-4b9f-a17c-a778967284e3', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187692ad-3389-454f-b2bc-bae6de1a675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:33 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Volume volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 (a3cff0ad-713d-4b9f-a17c-a778967284e3): created successfully Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187692ad-3389-454f-b2bc-bae6de1a675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:33 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (a7083e4e-6757-47ca-9254-e7c422e943a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:33 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5d5d25f7-e050-48b5-beda-134b195f23ec tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:06:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:34 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot 160455f4-2fb5-4fce-84a9-ab5cc618dafb of volume a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:34 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80cf61-6590-4b9d-9bde-e7ac7dd3b464]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:34 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 Sep 25 14:06:34 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:35 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3" returned: 0 in 0.362s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:35 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb 1G Sep 25 14:06:35 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:35 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb 1G" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:35 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb Sep 25 14:06:35 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:35 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb" returned: 0 in 0.294s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:35 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb is being set with open permissions: ugo+rw Sep 25 14:06:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:35 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb Sep 25 14:06:35 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:36 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb" returned: 0 in 0.244s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=142,cinder:INSERT=51,cinder:UPDATE=231,cinder:DELETE=18 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:36 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info Sep 25 14:06:36 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:36 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info" returned: 0 in 0.262s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:36 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info is being set with open permissions: ugo+rw Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:36 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info Sep 25 14:06:36 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:36 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.info" returned: 0 in 0.263s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=170,cinder:UPDATE=201,cinder:DELETE=16,cinder:INSERT=59 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:06:36 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-6e65117f-1c4d-4fc5-89a0-00ae6adb7680 tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-160455f4-2fb5-4fce-84a9-ab5cc618dafb-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-160455f4-2fb5-4fce-84a9-ab5cc618dafb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-a3cff0ad-713d-4b9f-a17c-a778967284e3" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-a3cff0ad-713d-4b9f-a17c-a778967284e3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-160455f4-2fb5-4fce-84a9-ab5cc618dafb" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-160455f4-2fb5-4fce-84a9-ab5cc618dafb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot 160455f4-2fb5-4fce-84a9-ab5cc618dafb of volume a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0750e-ff96-449b-a1a1-14037e250d44]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:37 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb Sep 25 14:06:37 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:37 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb" returned: 0 in 0.410s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:37 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3cff0ad-713d-4b9f-a17c-a778967284e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:37 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a783d-8460-4a55-8367-5700d60eec72]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:37 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 Sep 25 14:06:37 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:37 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3" returned: 0 in 0.405s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:37 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb Sep 25 14:06:37 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:38 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:38 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb Sep 25 14:06:38 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:38 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3.160455f4-2fb5-4fce-84a9-ab5cc618dafb" returned: 0 in 0.254s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-160455f4-2fb5-4fce-84a9-ab5cc618dafb" released by "_delete_snapshot" :: held 1.565s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-a3cff0ad-713d-4b9f-a17c-a778967284e3" released by "delete_snapshot" :: held 1.586s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Created reservations ['33570689-34fc-46c5-baa8-c47c796d8329', '5f967e48-75ec-4c7a-9da6-35009f4a9ce9', '18f4ebe4-1dbc-4b2a-8394-e29e7904e7e4', 'c8fb99fc-59d4-4550-9f16-32e3807923ab'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:38 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5fdb7ba0-15f4-4aa6-aadc-09c7a0fcf4d5 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-160455f4-2fb5-4fce-84a9-ab5cc618dafb-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-a3cff0ad-713d-4b9f-a17c-a778967284e3-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Lock "cinder-a3cff0ad-713d-4b9f-a17c-a778967284e3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-a3cff0ad-713d-4b9f-a17c-a778967284e3" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-a3cff0ad-713d-4b9f-a17c-a778967284e3" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aec3ed-9dc6-4640-abfc-f798bc1f55d8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:39 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 Sep 25 14:06:39 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:39 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3" returned: 0 in 0.405s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:39 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3 Sep 25 14:06:39 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:39 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-a3cff0ad-713d-4b9f-a17c-a778967284e3" returned: 0 in 0.241s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-a3cff0ad-713d-4b9f-a17c-a778967284e3" released by "delete_volume" :: held 0.708s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Created reservations ['eb7957ba-7da5-4d4e-906d-d48ccaaf2bdf', 'dfe3b20a-ecc6-4e13-aab9-6e8941fc8f60', '6f7c845c-2d0f-4921-8391-03f64e68941c', '89f3c768-0f24-4600-9126-5f13f37eb889'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:39 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:39 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:40 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-9e993c41-0382-409c-ba3b-4a4839946dae tempest-ProjectMemberTests-1443408843 None] Lock "cinder-a3cff0ad-713d-4b9f-a17c-a778967284e3-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (2acb3044-1931-4715-87b9-101f97482475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392d4b97-3fc3-4c4d-a405-3de13be1ea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392d4b97-3fc3-4c4d-a405-3de13be1ea54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138962027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037b55f1-7eb8-4f7d-a2f8-53719185145f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:41Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4d058f-f850-4738-8dde-c36aae357f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4d058f-f850-4738-8dde-c36aae357f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285c7227-b9df-4332-8d5b-f75e8ae00a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285c7227-b9df-4332-8d5b-f75e8ae00a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037b55f1-7eb8-4f7d-a2f8-53719185145f', 'volume_name': 'volume-037b55f1-7eb8-4f7d-a2f8-53719185145f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a2210-ad7b-46fa-8a3e-9d78db6b3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a2210-ad7b-46fa-8a3e-9d78db6b3811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a67644-291e-4e7a-a62b-9b8f76616a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Volume 037b55f1-7eb8-4f7d-a2f8-53719185145f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037b55f1-7eb8-4f7d-a2f8-53719185145f', 'volume_size': 1} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138962027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037b55f1-7eb8-4f7d-a2f8-53719185145f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:41Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Creating volume 037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:40 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:40 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f 1073741824 Sep 25 14:06:40 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:41 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f 1073741824" returned: 0 in 0.411s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:41 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f Sep 25 14:06:41 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:41 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f" returned: 0 in 0.255s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a67644-291e-4e7a-a62b-9b8f76616a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037b55f1-7eb8-4f7d-a2f8-53719185145f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2874eb38-b1f1-4abc-ab6b-e57dd7336259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:41 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Volume volume-037b55f1-7eb8-4f7d-a2f8-53719185145f (037b55f1-7eb8-4f7d-a2f8-53719185145f): created successfully Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2874eb38-b1f1-4abc-ab6b-e57dd7336259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (2acb3044-1931-4715-87b9-101f97482475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:41 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c01fa5f4-5826-4928-8248-30d4b9e3d251 tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot ffe4f442-9274-4190-b3cd-caf18489615a of volume 037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a4803e-31af-4e50-b8e5-0caeb11d99b8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:41 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f Sep 25 14:06:41 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:42 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f" returned: 0 in 0.374s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:42 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a 1G Sep 25 14:06:42 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:42 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a 1G" returned: 0 in 0.417s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037b55f1-7eb8-4f7d-a2f8-53719185145f -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:42 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037b55f1-7eb8-4f7d-a2f8-53719185145f -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a Sep 25 14:06:42 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:42 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037b55f1-7eb8-4f7d-a2f8-53719185145f -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a" returned: 0 in 0.300s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:42 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a is being set with open permissions: ugo+rw Sep 25 14:06:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:42 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a Sep 25 14:06:42 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:43 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a" returned: 0 in 0.259s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:43 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info Sep 25 14:06:43 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:43 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:43 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info is being set with open permissions: ugo+rw Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:43 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info Sep 25 14:06:43 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:43 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.info" returned: 0 in 0.245s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:43 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d0d6069a-68b3-4346-8a7a-c57dc0c55e7c tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-ffe4f442-9274-4190-b3cd-caf18489615a-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-ffe4f442-9274-4190-b3cd-caf18489615a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-037b55f1-7eb8-4f7d-a2f8-53719185145f" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-037b55f1-7eb8-4f7d-a2f8-53719185145f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-ffe4f442-9274-4190-b3cd-caf18489615a" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-ffe4f442-9274-4190-b3cd-caf18489615a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot ffe4f442-9274-4190-b3cd-caf18489615a of volume 037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[207432ab-035b-42cc-96e5-19b1315cb238]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:44 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a Sep 25 14:06:44 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:44 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-037b55f1-7eb8-4f7d-a2f8-53719185145f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061de1d-dc5e-44ee-b649-fae624c7ffab]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:44 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f Sep 25 14:06:44 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:44 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f" returned: 0 in 0.367s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:44 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a Sep 25 14:06:44 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:45 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:45 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a Sep 25 14:06:45 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:45 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f.ffe4f442-9274-4190-b3cd-caf18489615a" returned: 0 in 0.288s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-ffe4f442-9274-4190-b3cd-caf18489615a" released by "_delete_snapshot" :: held 1.522s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-037b55f1-7eb8-4f7d-a2f8-53719185145f" released by "delete_snapshot" :: held 1.545s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Created reservations ['857dfa53-b79f-4c4a-a69c-2f6572667351', '4cdf3a84-f853-41e8-bce1-6aa6123690c2', 'e0f68206-dda3-4ec0-b1c0-d335124fb758', 'e2f3c670-8984-460b-bdfc-fd9b1197c82d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:45 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-580a4c54-7863-47d8-b1fb-5a8c0616c38d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-ffe4f442-9274-4190-b3cd-caf18489615a-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-037b55f1-7eb8-4f7d-a2f8-53719185145f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-037b55f1-7eb8-4f7d-a2f8-53719185145f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-037b55f1-7eb8-4f7d-a2f8-53719185145f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-037b55f1-7eb8-4f7d-a2f8-53719185145f" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7c654-377f-4fa1-bd41-ad5c1d38c11f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:46 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f Sep 25 14:06:46 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:46 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:46 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f Sep 25 14:06:46 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:46 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-037b55f1-7eb8-4f7d-a2f8-53719185145f" returned: 0 in 0.234s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-037b55f1-7eb8-4f7d-a2f8-53719185145f" released by "delete_volume" :: held 0.673s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:46 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Created reservations ['6130e146-6b59-4a16-989a-ff44d2228ceb', '875b39f1-ba0a-48c2-b807-535d5d5f9453', '6633333f-020d-4445-bd79-bc8cfc1ee6d5', '7720f788-da96-4a11-8f6d-bc2127739e2b'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:47 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:47 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:47 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.260s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-ec4d8ccb-f7c0-4aa0-958a-670eecaceb3e tempest-ProjectMemberTests-1443408843 None] Lock "cinder-037b55f1-7eb8-4f7d-a2f8-53719185145f-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (5935fe05-36f8-4c97-a103-1b37cdaff8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b34f00-a1d3-4f2f-a7d9-b92f6f40ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b34f00-a1d3-4f2f-a7d9-b92f6f40ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558014754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944562b8-c4a5-46f0-907f-7b581eddee2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:48Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd23555-b4e3-49b7-9189-39a934891067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd23555-b4e3-49b7-9189-39a934891067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bfce6b-ff10-41db-9288-b046b9455c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bfce6b-ff10-41db-9288-b046b9455c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944562b8-c4a5-46f0-907f-7b581eddee2f', 'volume_name': 'volume-944562b8-c4a5-46f0-907f-7b581eddee2f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481cddfe-0853-4649-96b4-3faedba46004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481cddfe-0853-4649-96b4-3faedba46004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d18ab4-60d2-4c77-9954-a31db42c3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Volume 944562b8-c4a5-46f0-907f-7b581eddee2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944562b8-c4a5-46f0-907f-7b581eddee2f', 'volume_size': 1} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558014754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944562b8-c4a5-46f0-907f-7b581eddee2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:48Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Creating volume 944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:47 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:47 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f 1073741824 Sep 25 14:06:47 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:48 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f 1073741824" returned: 0 in 0.401s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:48 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f Sep 25 14:06:48 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:48 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f" returned: 0 in 0.242s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d18ab4-60d2-4c77-9954-a31db42c3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944562b8-c4a5-46f0-907f-7b581eddee2f', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2434cd8-8885-4cde-80dd-01bb80fbd87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:48 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Volume volume-944562b8-c4a5-46f0-907f-7b581eddee2f (944562b8-c4a5-46f0-907f-7b581eddee2f): created successfully Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2434cd8-8885-4cde-80dd-01bb80fbd87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (5935fe05-36f8-4c97-a103-1b37cdaff8ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:48 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-dc59ca25-0dfe-40c8-ad95-343dd2282f71 tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot 22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 of volume 944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59d175-7efc-4bb8-97a4-c2b7eb33616f]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:48 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:49 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f Sep 25 14:06:49 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:49 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:49 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 1G Sep 25 14:06:49 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:49 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 1G" returned: 0 in 0.399s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944562b8-c4a5-46f0-907f-7b581eddee2f -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:49 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944562b8-c4a5-46f0-907f-7b581eddee2f -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 Sep 25 14:06:49 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:50 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944562b8-c4a5-46f0-907f-7b581eddee2f -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" returned: 0 in 0.293s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 is being set with open permissions: ugo+rw Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:50 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 Sep 25 14:06:50 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:50 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" returned: 0 in 0.234s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:50 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info Sep 25 14:06:50 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:50 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info" returned: 0 in 0.261s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info is being set with open permissions: ugo+rw Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:50 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info Sep 25 14:06:50 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:50 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.info" returned: 0 in 0.236s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:50 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-154f5c50-ad3d-4899-b0d4-e96d9a7d3472 tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-944562b8-c4a5-46f0-907f-7b581eddee2f" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-944562b8-c4a5-46f0-907f-7b581eddee2f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot 22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 of volume 944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b316c-e8de-4fe6-98f6-9661aa4269ee]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:51 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 Sep 25 14:06:51 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:51 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" returned: 0 in 0.361s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944562b8-c4a5-46f0-907f-7b581eddee2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[39549afa-8a02-44f4-a52f-5157effa41e0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:51 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f Sep 25 14:06:51 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:51 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f" returned: 0 in 0.351s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:51 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 Sep 25 14:06:51 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:52 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" returned: 0 in 0.332s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:52 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63 Sep 25 14:06:52 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:52 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f.22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" returned: 0 in 0.247s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63" released by "_delete_snapshot" :: held 1.399s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-944562b8-c4a5-46f0-907f-7b581eddee2f" released by "delete_snapshot" :: held 1.420s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Created reservations ['f8bc3736-e82d-4394-b37d-2db2afb99dc5', '55e21292-f783-42e7-a59c-95e362f8dd4e', '8e08b3aa-deb2-4418-b13c-9d6f2c42ef45', '4563a9e6-991d-4caa-815a-583bd071f411'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:52 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8bdf86ed-e17a-45d2-8d11-d2b48a124f03 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-22fd8430-cc13-43ff-b4f9-e3c2ec5c0f63-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-944562b8-c4a5-46f0-907f-7b581eddee2f-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-944562b8-c4a5-46f0-907f-7b581eddee2f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-944562b8-c4a5-46f0-907f-7b581eddee2f" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-944562b8-c4a5-46f0-907f-7b581eddee2f" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd90e0-2dab-403a-a77e-6aef14565787]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:53 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f Sep 25 14:06:53 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:53 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f" returned: 0 in 0.371s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:53 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f Sep 25 14:06:53 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:53 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-944562b8-c4a5-46f0-907f-7b581eddee2f" returned: 0 in 0.240s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-944562b8-c4a5-46f0-907f-7b581eddee2f" released by "delete_volume" :: held 0.667s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:53 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Created reservations ['d2cf2c24-9e69-4759-93c4-0755e647bef4', 'f70ee9dd-cdc3-4244-8388-ab571d7e4639', '1c71beaf-4a68-4081-b7a0-3370a6b1055b', '1b89187c-08da-4879-972a-9c9ce382761e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:54 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:06:54 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:54 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.291s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:06:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e57a0e46-b2e6-4a82-b4eb-a173751ebd21 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-944562b8-c4a5-46f0-907f-7b581eddee2f-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (80617185-d644-4f95-ade9-0d690fa1ab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27bc3a8-27c7-4679-8661-4cd3eb5a60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27bc3a8-27c7-4679-8661-4cd3eb5a60fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992849830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327dc584-c9e5-4b47-9aaa-e224063a21a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:55Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84536ae1-0f34-417a-a6a6-7ccda736e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84536ae1-0f34-417a-a6a6-7ccda736e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2234e7-6579-4683-9b0a-6e1d63d47b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2234e7-6579-4683-9b0a-6e1d63d47b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327dc584-c9e5-4b47-9aaa-e224063a21a7', 'volume_name': 'volume-327dc584-c9e5-4b47-9aaa-e224063a21a7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcca367-c2a0-4320-b693-3725b47474a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcca367-c2a0-4320-b693-3725b47474a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d4b751-7b53-4202-80fe-48d14ce9c4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:54 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Volume 327dc584-c9e5-4b47-9aaa-e224063a21a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327dc584-c9e5-4b47-9aaa-e224063a21a7', 'volume_size': 1} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992849830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327dc584-c9e5-4b47-9aaa-e224063a21a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:06:55Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Creating volume 327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:06:54 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:06:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:54 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 1073741824 Sep 25 14:06:54 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:55 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 1073741824" returned: 0 in 0.417s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:55 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 Sep 25 14:06:55 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:55 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7" returned: 0 in 0.243s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d4b751-7b53-4202-80fe-48d14ce9c4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327dc584-c9e5-4b47-9aaa-e224063a21a7', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4b77bd-43fb-43c5-8619-d930e80946be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:06:55 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Volume volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 (327dc584-c9e5-4b47-9aaa-e224063a21a7): created successfully Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4b77bd-43fb-43c5-8619-d930e80946be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:06:55 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (80617185-d644-4f95-ade9-0d690fa1ab2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:06:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5a5c5359-106b-4de0-b5fb-059e741a337a tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot b7d1eb26-46c2-433e-aa89-a189961f34b4 of volume 327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e90c51-e1ed-4aac-847b-7fed04f39a0c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:56 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 Sep 25 14:06:56 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:56 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7" returned: 0 in 0.374s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:56 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 1G Sep 25 14:06:56 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:56 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 1G" returned: 0 in 0.403s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:56 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:56 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 Sep 25 14:06:56 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:57 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4" returned: 0 in 0.288s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:57 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 is being set with open permissions: ugo+rw Sep 25 14:06:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:57 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 Sep 25 14:06:57 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:57 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:57 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info Sep 25 14:06:57 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:57 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info" returned: 0 in 0.305s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:57 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info is being set with open permissions: ugo+rw Sep 25 14:06:57 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:57 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info Sep 25 14:06:57 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:58 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.info" returned: 0 in 0.265s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:06:58 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-926a3593-fa97-4789-8453-dc561ab7787c tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-b7d1eb26-46c2-433e-aa89-a189961f34b4-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-b7d1eb26-46c2-433e-aa89-a189961f34b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-327dc584-c9e5-4b47-9aaa-e224063a21a7" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-327dc584-c9e5-4b47-9aaa-e224063a21a7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-b7d1eb26-46c2-433e-aa89-a189961f34b4" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-b7d1eb26-46c2-433e-aa89-a189961f34b4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot b7d1eb26-46c2-433e-aa89-a189961f34b4 of volume 327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25484a-6925-4091-a77a-0f1a34f5aa3b]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:58 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 Sep 25 14:06:58 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:58 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327dc584-c9e5-4b47-9aaa-e224063a21a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[28176034-f489-4145-b066-ebceb0e7c26a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:06:58 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:58 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 Sep 25 14:06:58 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:59 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:59 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 Sep 25 14:06:59 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:59 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4" returned: 0 in 0.350s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:06:59 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4 Sep 25 14:06:59 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:06:59 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7.b7d1eb26-46c2-433e-aa89-a189961f34b4" returned: 0 in 0.261s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-b7d1eb26-46c2-433e-aa89-a189961f34b4" released by "_delete_snapshot" :: held 1.472s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-327dc584-c9e5-4b47-9aaa-e224063a21a7" released by "delete_snapshot" :: held 1.496s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Created reservations ['e450be9a-6ecc-4344-a4ec-d5cea64a1538', '2cc78ccd-5752-4e37-a0b1-b679504725c8', 'c5ee2ef8-48bc-4e4b-bf2d-e77f4322e49d', '258b2e35-d611-4211-aa46-2c0738084950'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:06:59 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:06:59 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-30b8c69d-e9d9-4748-9d29-f1fb69819c9d tempest-ProjectMemberTests-1443408843 None] Lock "cinder-b7d1eb26-46c2-433e-aa89-a189961f34b4-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-327dc584-c9e5-4b47-9aaa-e224063a21a7-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Lock "cinder-327dc584-c9e5-4b47-9aaa-e224063a21a7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-327dc584-c9e5-4b47-9aaa-e224063a21a7" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-327dc584-c9e5-4b47-9aaa-e224063a21a7" acquired by "delete_volume" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27972e1-46aa-4723-bcbb-d80110ffd4c0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:00 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 Sep 25 14:07:00 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:00 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:00 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:00 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7 Sep 25 14:07:00 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:01 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-327dc584-c9e5-4b47-9aaa-e224063a21a7" returned: 0 in 0.252s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-327dc584-c9e5-4b47-9aaa-e224063a21a7" released by "delete_volume" :: held 0.694s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Created reservations ['dc98cb3a-38a7-4f50-881d-3f9ae43dc1ad', '98c9a4da-662d-48fb-a207-108ca7847db8', '99af4e61-a608-40a8-b7f8-cd113c02b8cd', '8c64ca5e-2950-4070-92cb-0e26a18a29a8'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:01 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:01 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:01 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.268s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:01 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:07:01 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-751fb103-b914-40c7-94f2-3d8bb92a878b tempest-ProjectMemberTests-1443408843 None] Lock "cinder-327dc584-c9e5-4b47-9aaa-e224063a21a7-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (8e9be72a-be9c-47fd-9208-a353f8a4b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b688d72e-c7e1-447d-9254-f9f3c9cbba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b688d72e-c7e1-447d-9254-f9f3c9cbba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059235719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3918a4-6567-41a5-b283-6aac2c056e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:02Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262b82d3-9908-4359-839f-a1d0c117499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262b82d3-9908-4359-839f-a1d0c117499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c494693e-7ee2-46ee-b465-0bfa3c3de9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c494693e-7ee2-46ee-b465-0bfa3c3de9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3918a4-6567-41a5-b283-6aac2c056e37', 'volume_name': 'volume-ec3918a4-6567-41a5-b283-6aac2c056e37', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be1bd6a-5815-472e-bb25-0fc0d0f47e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be1bd6a-5815-472e-bb25-0fc0d0f47e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0275db9a-83dd-41e4-85f4-5b01868622c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Volume ec3918a4-6567-41a5-b283-6aac2c056e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3918a4-6567-41a5-b283-6aac2c056e37', 'volume_size': 1} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059235719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3918a4-6567-41a5-b283-6aac2c056e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d643b0ac903d4f4a9381119fb60d07cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:02Z,use_quota=True,user_id='d986b0fa221b4926a9d5f5ce4423a130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Creating volume ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:07:02 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:02 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 1073741824 Sep 25 14:07:02 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:02 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 1073741824" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:02 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 Sep 25 14:07:02 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:02 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37" returned: 0 in 0.273s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0275db9a-83dd-41e4-85f4-5b01868622c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3918a4-6567-41a5-b283-6aac2c056e37', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556c21db-c96b-4cb4-b75f-8cec427e7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:02 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Volume volume-ec3918a4-6567-41a5-b283-6aac2c056e37 (ec3918a4-6567-41a5-b283-6aac2c056e37): created successfully Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556c21db-c96b-4cb4-b75f-8cec427e7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Flow 'volume_create_manager' (8e9be72a-be9c-47fd-9208-a353f8a4b82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:03 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d66dc7ce-d34f-459d-9a74-24927a138f24 tempest-ProjectMemberTests-1443408843 None] Created volume successfully. Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Creating offline snapshot 5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 of volume ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4075ac-d255-44b0-bf36-6de5526391e5]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:03 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 Sep 25 14:07:03 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:03 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37" returned: 0 in 0.381s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:03 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:03 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 1G Sep 25 14:07:03 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:04 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 1G" returned: 0 in 0.450s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3918a4-6567-41a5-b283-6aac2c056e37 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:04 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3918a4-6567-41a5-b283-6aac2c056e37 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 Sep 25 14:07:04 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:04 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3918a4-6567-41a5-b283-6aac2c056e37 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" returned: 0 in 0.329s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:04 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 is being set with open permissions: ugo+rw Sep 25 14:07:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:04 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 Sep 25 14:07:04 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:04 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" returned: 0 in 0.246s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:04 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:04 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info Sep 25 14:07:04 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:05 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info" returned: 0 in 0.269s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:05 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info is being set with open permissions: ugo+rw Sep 25 14:07:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:05 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info Sep 25 14:07:05 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:05 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.info" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:05 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:05 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4d63aa69-e89a-47e0-a8ce-2ee4d0520040 tempest-ProjectMemberTests-1443408843 None] Create snapshot completed successfully Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-ec3918a4-6567-41a5-b283-6aac2c056e37" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-ec3918a4-6567-41a5-b283-6aac2c056e37" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Deleting offline snapshot 5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 of volume ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] snapshot_file for this snap is: volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5d53a-1b08-456c-a6f9-9a76f313500d]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:06 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:06 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 Sep 25 14:07:06 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:07 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" returned: 0 in 0.384s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec3918a4-6567-41a5-b283-6aac2c056e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[67135bf7-25cf-4bdf-a8ab-65e05dfd5e98]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:07 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 Sep 25 14:07:07 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:07 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37" returned: 0 in 0.376s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:07 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 Sep 25 14:07:07 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:07 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" returned: 0 in 0.330s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:07 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:07 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3 Sep 25 14:07:07 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:08 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37.5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" returned: 0 in 0.304s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3" released by "_delete_snapshot" :: held 1.493s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-ec3918a4-6567-41a5-b283-6aac2c056e37" released by "delete_snapshot" :: held 1.519s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Created reservations ['21a8f23f-d7e5-4f5d-9aad-7c2e11551f37', 'd5f865d0-52da-4e22-9145-ec1b90ca3535', '6982d004-3b9e-48f6-a85d-dc6af6c2e5fa', '0ff69d9a-395b-4354-bba8-be9b6dbde733'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:08 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Delete snapshot completed successfully. Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-20536734-cea3-45d4-b1d8-1bb4cb1050c7 tempest-ProjectMemberTests-1443408843 None] Lock "cinder-5c3b469f-b8f2-4a16-87d3-bb07b4d5d4f3-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-ec3918a4-6567-41a5-b283-6aac2c056e37-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Lock "cinder-ec3918a4-6567-41a5-b283-6aac2c056e37-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Acquiring lock "cinder-quobyte-ec3918a4-6567-41a5-b283-6aac2c056e37" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-ec3918a4-6567-41a5-b283-6aac2c056e37" acquired by "delete_volume" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2790158-ed79-49f3-8937-04e0f5d47c55]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:08 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:08 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 Sep 25 14:07:08 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:09 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37" returned: 0 in 0.391s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:09 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37 Sep 25 14:07:09 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:09 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-ec3918a4-6567-41a5-b283-6aac2c056e37" returned: 0 in 0.280s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Lock "cinder-quobyte-ec3918a4-6567-41a5-b283-6aac2c056e37" released by "delete_volume" :: held 0.742s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Created reservations ['3bc1fd04-a1db-4833-b957-31cc64608950', '66be07e1-410c-4b63-b787-8ab08c0f940c', 'e67fecbc-0a77-4c1d-9699-c5b81305077c', '31016796-3c48-487a-9f9f-1598e87f3cb9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:09 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:09 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:09 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.320s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:10 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Deleted volume successfully. Sep 25 14:07:10 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:10 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8f725136-7a17-48b3-a201-c648df857c5f tempest-ProjectMemberTests-1443408843 None] Lock "cinder-ec3918a4-6567-41a5-b283-6aac2c056e37-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:10 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.289s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:07:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (657b763a-4a46-4b3b-ad11-33e52ef1253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1bba69-94ce-4fac-aaab-50f54ca46ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1bba69-94ce-4fac-aaab-50f54ca46ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699414536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875e65ce-53eb-459c-bc42-1666903a2ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:14Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee74033a-90c6-43d2-96cf-50eb728b148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee74033a-90c6-43d2-96cf-50eb728b148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a4ce76-4f62-474a-918e-2e2e8a346d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a4ce76-4f62-474a-918e-2e2e8a346d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875e65ce-53eb-459c-bc42-1666903a2ed8', 'volume_name': 'volume-875e65ce-53eb-459c-bc42-1666903a2ed8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e870992d-6192-4092-bf03-e5607969b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e870992d-6192-4092-bf03-e5607969b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36569df3-a06a-41a5-8f18-26f65099c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:13 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Volume 875e65ce-53eb-459c-bc42-1666903a2ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875e65ce-53eb-459c-bc42-1666903a2ed8', 'volume_size': 1} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699414536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875e65ce-53eb-459c-bc42-1666903a2ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:14Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Creating volume 875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:07:13 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:07:13 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:13 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 1073741824 Sep 25 14:07:13 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:14 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 1073741824" returned: 0 in 0.442s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:14 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 Sep 25 14:07:14 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:14 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36569df3-a06a-41a5-8f18-26f65099c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875e65ce-53eb-459c-bc42-1666903a2ed8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95015486-577c-41c8-aeec-b6009273fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Volume volume-875e65ce-53eb-459c-bc42-1666903a2ed8 (875e65ce-53eb-459c-bc42-1666903a2ed8): created successfully Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95015486-577c-41c8-aeec-b6009273fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (657b763a-4a46-4b3b-ad11-33e52ef1253c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:14 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-f96709a4-1853-4350-b3ec-9325aa9432b9 tempest-ProjectReaderTests-938086930 None] Created volume successfully. Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Creating offline snapshot 2ca50fca-1480-4b8f-a035-ebdad4947837 of volume 875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7903514-f8b4-47a6-9181-84d401cd423a]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:15 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 Sep 25 14:07:15 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:15 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8" returned: 0 in 0.377s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:15 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 1G Sep 25 14:07:15 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:15 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 1G" returned: 0 in 0.435s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875e65ce-53eb-459c-bc42-1666903a2ed8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:15 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875e65ce-53eb-459c-bc42-1666903a2ed8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 Sep 25 14:07:15 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:16 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875e65ce-53eb-459c-bc42-1666903a2ed8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837" returned: 0 in 0.321s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:16 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 is being set with open permissions: ugo+rw Sep 25 14:07:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:16 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 Sep 25 14:07:16 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:16 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837" returned: 0 in 0.272s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:16 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info Sep 25 14:07:16 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:16 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info" returned: 0 in 0.262s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:16 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info is being set with open permissions: ugo+rw Sep 25 14:07:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:16 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info Sep 25 14:07:16 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:17 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.info" returned: 0 in 0.246s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:17 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d3c80f8b-fb50-4ebf-9029-ecb47a5b7b14 tempest-ProjectReaderTests-938086930 None] Create snapshot completed successfully Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-2ca50fca-1480-4b8f-a035-ebdad4947837-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Lock "cinder-2ca50fca-1480-4b8f-a035-ebdad4947837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-875e65ce-53eb-459c-bc42-1666903a2ed8" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-875e65ce-53eb-459c-bc42-1666903a2ed8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-2ca50fca-1480-4b8f-a035-ebdad4947837" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-2ca50fca-1480-4b8f-a035-ebdad4947837" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Deleting offline snapshot 2ca50fca-1480-4b8f-a035-ebdad4947837 of volume 875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] snapshot_file for this snap is: volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eadea8-3f8f-4558-baa2-ea9648ceed8e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:18 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 Sep 25 14:07:18 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:18 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837" returned: 0 in 0.389s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875e65ce-53eb-459c-bc42-1666903a2ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca05b3-c1bd-4880-8fde-d707c46ba87e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:19 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 Sep 25 14:07:19 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:19 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8" returned: 0 in 0.375s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:19 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 Sep 25 14:07:19 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:19 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837" returned: 0 in 0.339s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:19 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837 Sep 25 14:07:19 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:19 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8.2ca50fca-1480-4b8f-a035-ebdad4947837" returned: 0 in 0.245s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-2ca50fca-1480-4b8f-a035-ebdad4947837" released by "_delete_snapshot" :: held 1.450s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-875e65ce-53eb-459c-bc42-1666903a2ed8" released by "delete_snapshot" :: held 1.476s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Created reservations ['1ca73baa-a538-404d-bf5a-2da2cba4f261', '7d1bcb61-b399-4d72-8bdb-2cc04b29b4c2', '22debaf7-3fd8-4375-a0f9-890924aaf0a4', '0f522345-aef0-4a19-9535-0761962c207d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:20 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Delete snapshot completed successfully. Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-12d660c3-d71f-4f54-85bd-a4ca0c6c2837 tempest-ProjectReaderTests-938086930 None] Lock "cinder-2ca50fca-1480-4b8f-a035-ebdad4947837-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-875e65ce-53eb-459c-bc42-1666903a2ed8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Lock "cinder-875e65ce-53eb-459c-bc42-1666903a2ed8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-875e65ce-53eb-459c-bc42-1666903a2ed8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-875e65ce-53eb-459c-bc42-1666903a2ed8" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1c5414-13e8-418b-aee8-2038cc2afff1]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:20 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:20 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 Sep 25 14:07:20 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:21 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8" returned: 0 in 0.390s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:21 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8 Sep 25 14:07:21 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:21 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-875e65ce-53eb-459c-bc42-1666903a2ed8" returned: 0 in 0.255s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-875e65ce-53eb-459c-bc42-1666903a2ed8" released by "delete_volume" :: held 0.707s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Created reservations ['baee528f-677d-45a7-8e72-b02632645ee5', 'bf1edc66-2c9d-4951-a177-c3fdb39712c8', '3da1d202-2c3b-4950-a1db-a7e4a11fb551', '9bdac56a-6fe3-4a5e-854e-b1f23a791461'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:21 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:21 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:21 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.264s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:21 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Deleted volume successfully. Sep 25 14:07:21 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-988c6a03-fd17-471a-9463-e5722486764a tempest-ProjectReaderTests-938086930 None] Lock "cinder-875e65ce-53eb-459c-bc42-1666903a2ed8-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (8bfcd769-3af8-4d93-92a1-507f01f56c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a225cd98-240f-4f0e-b220-3a5351886738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a225cd98-240f-4f0e-b220-3a5351886738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150295519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99883df5-56f0-4641-866d-25d855bfd465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:22Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f431ee-8f75-4cef-aa2d-90e570c3b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f431ee-8f75-4cef-aa2d-90e570c3b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f786550d-6517-4312-8fa6-4e21a265ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f786550d-6517-4312-8fa6-4e21a265ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99883df5-56f0-4641-866d-25d855bfd465', 'volume_name': 'volume-99883df5-56f0-4641-866d-25d855bfd465', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee65751c-eeb1-47ed-9945-989c6c0a673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee65751c-eeb1-47ed-9945-989c6c0a673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc42944b-47ec-4548-9165-82e5ed625702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:22 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Volume 99883df5-56f0-4641-866d-25d855bfd465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99883df5-56f0-4641-866d-25d855bfd465', 'volume_size': 1} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150295519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99883df5-56f0-4641-866d-25d855bfd465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:22Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Creating volume 99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:07:22 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:22 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 1073741824 Sep 25 14:07:22 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:22 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 1073741824" returned: 0 in 0.477s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:22 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:22 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 Sep 25 14:07:22 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:23 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465" returned: 0 in 0.272s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc42944b-47ec-4548-9165-82e5ed625702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99883df5-56f0-4641-866d-25d855bfd465', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f4717-ab1e-4da7-9d38-a85b3d1e56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:23 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Volume volume-99883df5-56f0-4641-866d-25d855bfd465 (99883df5-56f0-4641-866d-25d855bfd465): created successfully Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f4717-ab1e-4da7-9d38-a85b3d1e56ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:23 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (8bfcd769-3af8-4d93-92a1-507f01f56c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:23 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-a3301c52-158e-430a-aa71-4aa389c43ffe tempest-ProjectReaderTests-938086930 None] Created volume successfully. Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Creating offline snapshot 117a7276-ee99-4b2f-a802-96c0ad3aaf66 of volume 99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c5db1-45b4-4daa-94c7-d2922af26904]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:24 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 Sep 25 14:07:24 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:24 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465" returned: 0 in 0.374s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:24 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:24 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 1G Sep 25 14:07:24 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:25 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 1G" returned: 0 in 0.412s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99883df5-56f0-4641-866d-25d855bfd465 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:25 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99883df5-56f0-4641-866d-25d855bfd465 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 Sep 25 14:07:25 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:25 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99883df5-56f0-4641-866d-25d855bfd465 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66" returned: 0 in 0.352s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:25 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 is being set with open permissions: ugo+rw Sep 25 14:07:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:25 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 Sep 25 14:07:25 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:25 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66" returned: 0 in 0.249s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:25 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:26 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info Sep 25 14:07:26 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:26 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info" returned: 0 in 0.243s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:26 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info is being set with open permissions: ugo+rw Sep 25 14:07:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:26 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info Sep 25 14:07:26 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:26 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.info" returned: 0 in 0.279s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:26 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:26 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-16e775de-15c3-4511-83d6-06de89a47f1f tempest-ProjectReaderTests-938086930 None] Create snapshot completed successfully Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-117a7276-ee99-4b2f-a802-96c0ad3aaf66-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Lock "cinder-117a7276-ee99-4b2f-a802-96c0ad3aaf66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-99883df5-56f0-4641-866d-25d855bfd465" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-99883df5-56f0-4641-866d-25d855bfd465" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-117a7276-ee99-4b2f-a802-96c0ad3aaf66" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-117a7276-ee99-4b2f-a802-96c0ad3aaf66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Deleting offline snapshot 117a7276-ee99-4b2f-a802-96c0ad3aaf66 of volume 99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] snapshot_file for this snap is: volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbbb12c-37fd-45d4-8598-3790417880a1]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:27 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:27 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 Sep 25 14:07:27 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:28 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66" returned: 0 in 0.388s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99883df5-56f0-4641-866d-25d855bfd465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5e79e-d8d5-4ac4-a64f-7dddbaacc031]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:28 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 Sep 25 14:07:28 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:28 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:28 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 Sep 25 14:07:28 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:28 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66" returned: 0 in 0.344s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:28 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:28 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66 Sep 25 14:07:28 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:29 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465.117a7276-ee99-4b2f-a802-96c0ad3aaf66" returned: 0 in 0.257s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-117a7276-ee99-4b2f-a802-96c0ad3aaf66" released by "_delete_snapshot" :: held 1.456s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-99883df5-56f0-4641-866d-25d855bfd465" released by "delete_snapshot" :: held 1.478s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Created reservations ['a3048b7f-e3cb-409d-8db6-53717f110826', 'c718dfb9-2f8d-427e-b273-41073071c016', '1a6dcd83-f849-47ba-a847-f41e97921958', '2eee9536-de9c-44c3-8bcc-f6e370802b6d'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:29 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Delete snapshot completed successfully. Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-8e9f0cc3-8830-4a37-80dc-edb5669e2ddc tempest-ProjectReaderTests-938086930 None] Lock "cinder-117a7276-ee99-4b2f-a802-96c0ad3aaf66-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-99883df5-56f0-4641-866d-25d855bfd465-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Lock "cinder-99883df5-56f0-4641-866d-25d855bfd465-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-99883df5-56f0-4641-866d-25d855bfd465" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-99883df5-56f0-4641-866d-25d855bfd465" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b0d706-2d0b-4a49-8b10-2e5598fba189]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:29 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:30 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 Sep 25 14:07:30 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:30 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465" returned: 0 in 0.368s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:30 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465 Sep 25 14:07:30 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:30 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-99883df5-56f0-4641-866d-25d855bfd465" returned: 0 in 0.258s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-99883df5-56f0-4641-866d-25d855bfd465" released by "delete_volume" :: held 0.693s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Created reservations ['140c918b-e707-4d95-979c-0c04dc2ec265', '2ffbb3f2-a063-4178-94b6-67b55e88382b', '01a895d5-6419-4408-a48c-739c5fb9b9ac', '2e4e7784-5257-44e9-be0b-6deb3b9fb6d0'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:30 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:30 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:30 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.262s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:30 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:31 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Deleted volume successfully. Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-67aac1c9-a665-42db-b902-7f66b4ce22de tempest-ProjectReaderTests-938086930 None] Lock "cinder-99883df5-56f0-4641-866d-25d855bfd465-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (c3123310-d392-4358-a6d1-bc8af64716c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff45399-5414-4e32-ae4a-fe1559ab0ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff45399-5414-4e32-ae4a-fe1559ab0ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268393729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d505a807-bca9-4326-92ef-3914dc0762cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:31Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a47be83-6197-4a07-8bc8-ef94e2424d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a47be83-6197-4a07-8bc8-ef94e2424d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36dd813-2b91-4d06-91fa-fee00bf95050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36dd813-2b91-4d06-91fa-fee00bf95050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd505a807-bca9-4326-92ef-3914dc0762cc', 'volume_name': 'volume-d505a807-bca9-4326-92ef-3914dc0762cc', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d9a08b-21ba-4814-bc55-441854009dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d9a08b-21ba-4814-bc55-441854009dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86d32f3-bbc7-4af5-afff-31077309c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:31 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Volume d505a807-bca9-4326-92ef-3914dc0762cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d505a807-bca9-4326-92ef-3914dc0762cc', 'volume_size': 1} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268393729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d505a807-bca9-4326-92ef-3914dc0762cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:31Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Creating volume d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:07:31 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:07:31 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:31 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc 1073741824 Sep 25 14:07:31 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:32 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc 1073741824" returned: 0 in 0.434s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:32 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc Sep 25 14:07:32 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:32 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc" returned: 0 in 0.236s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86d32f3-bbc7-4af5-afff-31077309c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d505a807-bca9-4326-92ef-3914dc0762cc', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d802d-3d73-4a74-bad6-4c56992d450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:32 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Volume volume-d505a807-bca9-4326-92ef-3914dc0762cc (d505a807-bca9-4326-92ef-3914dc0762cc): created successfully Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d802d-3d73-4a74-bad6-4c56992d450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (c3123310-d392-4358-a6d1-bc8af64716c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:32 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-c2be8a94-f06f-40fd-b118-18edfe07b65d tempest-ProjectReaderTests-938086930 None] Created volume successfully. Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Creating offline snapshot 8614ae9b-2bb2-45dd-8aa4-806129ec638c of volume d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc3eff-8d33-49a1-9eae-b13cde76afd6]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:32 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:32 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc Sep 25 14:07:32 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:33 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc" returned: 0 in 0.372s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:33 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c 1G Sep 25 14:07:33 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:33 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c 1G" returned: 0 in 0.474s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d505a807-bca9-4326-92ef-3914dc0762cc -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:33 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d505a807-bca9-4326-92ef-3914dc0762cc -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c Sep 25 14:07:33 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:33 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d505a807-bca9-4326-92ef-3914dc0762cc -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c" returned: 0 in 0.322s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:33 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c is being set with open permissions: ugo+rw Sep 25 14:07:33 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:33 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c Sep 25 14:07:33 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:34 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c" returned: 0 in 0.264s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:34 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info Sep 25 14:07:34 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:34 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info" returned: 0 in 0.276s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:34 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info is being set with open permissions: ugo+rw Sep 25 14:07:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:34 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info Sep 25 14:07:34 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:34 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.info" returned: 0 in 0.308s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:34 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:34 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d2864563-589e-4a2d-a222-9dcd12862690 tempest-ProjectReaderTests-938086930 None] Create snapshot completed successfully Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-8614ae9b-2bb2-45dd-8aa4-806129ec638c-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Lock "cinder-8614ae9b-2bb2-45dd-8aa4-806129ec638c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-d505a807-bca9-4326-92ef-3914dc0762cc" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-d505a807-bca9-4326-92ef-3914dc0762cc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-8614ae9b-2bb2-45dd-8aa4-806129ec638c" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-8614ae9b-2bb2-45dd-8aa4-806129ec638c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Deleting offline snapshot 8614ae9b-2bb2-45dd-8aa4-806129ec638c of volume d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] snapshot_file for this snap is: volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dd391-1924-4e2f-9821-7bebbc1298e8]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:35 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:36 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c Sep 25 14:07:36 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:36 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c" returned: 0 in 0.390s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:36 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d505a807-bca9-4326-92ef-3914dc0762cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:07:36 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7351732-e64e-49b4-ac05-d31e48f18a7e]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:36 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc Sep 25 14:07:36 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:36 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc" returned: 0 in 0.379s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:36 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:36 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c Sep 25 14:07:36 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:37 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c" returned: 0 in 0.387s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:37 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c Sep 25 14:07:37 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:37 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc.8614ae9b-2bb2-45dd-8aa4-806129ec638c" returned: 0 in 0.291s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-8614ae9b-2bb2-45dd-8aa4-806129ec638c" released by "_delete_snapshot" :: held 1.556s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-d505a807-bca9-4326-92ef-3914dc0762cc" released by "delete_snapshot" :: held 1.579s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=133,cinder:DELETE=11,cinder:SELECT=103,cinder:INSERT=32 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=96,cinder:INSERT=38,cinder:UPDATE=121,cinder:DELETE=11 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Created reservations ['12534a73-eb46-4210-b8ff-134c6a1078bc', 'd30deddd-6bb1-40aa-afe1-98bc9b8b56aa', 'f5657073-193d-4222-a17c-564078e3b765', 'd8eff4b6-737f-412a-a31b-f6b14aac483c'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:37 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Delete snapshot completed successfully. Sep 25 14:07:37 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-1e523898-06d2-48f5-a1da-8883a6be45d1 tempest-ProjectReaderTests-938086930 None] Lock "cinder-8614ae9b-2bb2-45dd-8aa4-806129ec638c-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-d505a807-bca9-4326-92ef-3914dc0762cc-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Lock "cinder-d505a807-bca9-4326-92ef-3914dc0762cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-d505a807-bca9-4326-92ef-3914dc0762cc" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-d505a807-bca9-4326-92ef-3914dc0762cc" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8b318c-3658-46f4-911b-e66eb4898678]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:38 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc Sep 25 14:07:38 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:38 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc" returned: 0 in 0.412s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:38 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc Sep 25 14:07:38 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:38 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-d505a807-bca9-4326-92ef-3914dc0762cc" returned: 0 in 0.242s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-d505a807-bca9-4326-92ef-3914dc0762cc" released by "delete_volume" :: held 0.721s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Created reservations ['9664f1a9-6b50-41c4-aa98-8e38e00a6152', '5a61db25-c614-4e5b-afc1-b5ccf9af2b3a', '1deb698e-4eeb-44ab-8b91-cc729b6862fc', '552783bb-2a51-4a5d-8176-9f63477bdbf4'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:38 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:38 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:38 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:39 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.265s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:39 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Deleted volume successfully. Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-fab836b2-a928-4849-8156-1c5977666ea8 tempest-ProjectReaderTests-938086930 None] Lock "cinder-d505a807-bca9-4326-92ef-3914dc0762cc-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (f4c3d1d1-4b50-4d6d-bd88-99cbe847f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19661caf-1f5c-46ba-8711-15e07ef5b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19661caf-1f5c-46ba-8711-15e07ef5b58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164113636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8edfec-5baf-4b82-a421-6de050ff21c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:40Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e45923-f6dc-47bb-ac82-a8c5c3734d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e45923-f6dc-47bb-ac82-a8c5c3734d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aad23c-3b3a-4455-b582-95a43c267f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aad23c-3b3a-4455-b582-95a43c267f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8edfec-5baf-4b82-a421-6de050ff21c8', 'volume_name': 'volume-7a8edfec-5baf-4b82-a421-6de050ff21c8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef334139-3953-46f8-9e13-1aa074b8db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef334139-3953-46f8-9e13-1aa074b8db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0008acb8-c3dc-4032-9a1e-77499acd41c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:39 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Volume 7a8edfec-5baf-4b82-a421-6de050ff21c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8edfec-5baf-4b82-a421-6de050ff21c8', 'volume_size': 1} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164113636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8edfec-5baf-4b82-a421-6de050ff21c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:40Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Creating volume 7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:07:39 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:07:39 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:39 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 1073741824 Sep 25 14:07:39 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:40 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 1073741824" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:40 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 Sep 25 14:07:40 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:40 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8" returned: 0 in 0.262s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0008acb8-c3dc-4032-9a1e-77499acd41c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8edfec-5baf-4b82-a421-6de050ff21c8', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113ea134-5aef-43d9-af91-aeb19b0301b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:40 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Volume volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 (7a8edfec-5baf-4b82-a421-6de050ff21c8): created successfully Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113ea134-5aef-43d9-af91-aeb19b0301b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (f4c3d1d1-4b50-4d6d-bd88-99cbe847f12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:40 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-d1828b60-46a2-481b-a6a6-6f48215f11e2 tempest-ProjectReaderTests-938086930 None] Created volume successfully. Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Creating offline snapshot 6a6ff81e-1709-482b-990d-dac4d0ce653e of volume 7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd963e39-fa40-440c-bb06-f0b717c06184]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:40 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:40 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 Sep 25 14:07:40 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:41 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8" returned: 0 in 0.361s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:41 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e 1G Sep 25 14:07:41 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:41 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e 1G" returned: 0 in 0.393s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:41 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e Sep 25 14:07:41 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:41 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e" returned: 0 in 0.306s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:41 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e is being set with open permissions: ugo+rw Sep 25 14:07:41 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:41 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e Sep 25 14:07:41 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:42 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e" returned: 0 in 0.266s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:42 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info Sep 25 14:07:42 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:42 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info" returned: 0 in 0.286s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:42 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info is being set with open permissions: ugo+rw Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:42 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info Sep 25 14:07:42 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:42 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.info" returned: 0 in 0.254s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:42 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b6e09032-1ce3-4c4e-88c1-a5924b397b9b tempest-ProjectReaderTests-938086930 None] Create snapshot completed successfully Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-6a6ff81e-1709-482b-990d-dac4d0ce653e-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Lock "cinder-6a6ff81e-1709-482b-990d-dac4d0ce653e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:42 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-7a8edfec-5baf-4b82-a421-6de050ff21c8" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-7a8edfec-5baf-4b82-a421-6de050ff21c8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-6a6ff81e-1709-482b-990d-dac4d0ce653e" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-6a6ff81e-1709-482b-990d-dac4d0ce653e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Deleting offline snapshot 6a6ff81e-1709-482b-990d-dac4d0ce653e of volume 7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] snapshot_file for this snap is: volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83eaabb-ab95-4ab3-adfe-d7ac72746d02]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:43 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e Sep 25 14:07:43 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:43 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e" returned: 0 in 0.365s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a8edfec-5baf-4b82-a421-6de050ff21c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dee3b8b-fdb3-442d-b529-73906f9feedb]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:43 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 Sep 25 14:07:43 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:43 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8" returned: 0 in 0.364s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:43 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:43 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e Sep 25 14:07:43 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:44 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e" returned: 0 in 0.375s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:44 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e Sep 25 14:07:44 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:44 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8.6a6ff81e-1709-482b-990d-dac4d0ce653e" returned: 0 in 0.275s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-6a6ff81e-1709-482b-990d-dac4d0ce653e" released by "_delete_snapshot" :: held 1.481s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-7a8edfec-5baf-4b82-a421-6de050ff21c8" released by "delete_snapshot" :: held 1.504s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Created reservations ['ccb77f20-2998-42b6-bcbd-319052c5ee78', '9b5342ff-0117-4d6d-bf42-582c2fea9bc0', 'd64aca5a-2986-400b-89fb-49ca13c546dc', '146fe490-c557-46c2-9126-1fbb76daa740'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:44 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Delete snapshot completed successfully. Sep 25 14:07:44 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4b71ed56-9a76-45a0-8456-1ed54f274e66 tempest-ProjectReaderTests-938086930 None] Lock "cinder-6a6ff81e-1709-482b-990d-dac4d0ce653e-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-7a8edfec-5baf-4b82-a421-6de050ff21c8-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Lock "cinder-7a8edfec-5baf-4b82-a421-6de050ff21c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-7a8edfec-5baf-4b82-a421-6de050ff21c8" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-7a8edfec-5baf-4b82-a421-6de050ff21c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04d36c-3e2f-464b-aba3-67a835de2f9c]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:45 devstack sudo[109658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 Sep 25 14:07:45 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:45 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8" returned: 0 in 0.389s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:45 devstack sudo[109663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8 Sep 25 14:07:45 devstack sudo[109663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:45 devstack sudo[109663]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:45 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-7a8edfec-5baf-4b82-a421-6de050ff21c8" returned: 0 in 0.281s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-7a8edfec-5baf-4b82-a421-6de050ff21c8" released by "delete_volume" :: held 0.750s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Created reservations ['a99b65f8-7c03-4e67-91e9-cf8a3ed1310e', 'b0d13bcd-55ca-4a03-b333-d3074686e2a0', 'f2b27604-2684-48f2-aac6-b2eea62137da', 'df893124-13e8-435f-867d-b6654dc63ae2'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:46 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:46 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:46 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.298s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:46 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Deleted volume successfully. Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-e9091790-d375-45d4-9097-b8bb1c95c5b0 tempest-ProjectReaderTests-938086930 None] Lock "cinder-7a8edfec-5baf-4b82-a421-6de050ff21c8-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (bf5a90b7-19bf-4bd1-bd33-c1e7d29a64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b1c7a7-b2b5-4106-895b-4a9df6486d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b1c7a7-b2b5-4106-895b-4a9df6486d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467746696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9d19c8-6b30-462c-8922-41fc25a9b553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:47Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fd8117-cb2a-4efe-a56c-1f00d08d13c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fd8117-cb2a-4efe-a56c-1f00d08d13c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a8a708-9180-46f1-b435-b6cd80d78012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a8a708-9180-46f1-b435-b6cd80d78012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9d19c8-6b30-462c-8922-41fc25a9b553', 'volume_name': 'volume-bc9d19c8-6b30-462c-8922-41fc25a9b553', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7285b4a-5f60-48b9-a2f7-c2755dafac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7285b4a-5f60-48b9-a2f7-c2755dafac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd09bb6-9f4a-4762-97cb-69291d70d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:46 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Volume bc9d19c8-6b30-462c-8922-41fc25a9b553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9d19c8-6b30-462c-8922-41fc25a9b553', 'volume_size': 1} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467746696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9d19c8-6b30-462c-8922-41fc25a9b553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f0217d3e8e4714995a6e908137449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:07:47Z,use_quota=True,user_id='25b03100b8c7460a8a8f7169acf9a009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Creating volume bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:46 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:07:47 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:47 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 1073741824 Sep 25 14:07:47 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:47 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 1073741824" returned: 0 in 0.446s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:47 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 Sep 25 14:07:47 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:47 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553" returned: 0 in 0.283s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd09bb6-9f4a-4762-97cb-69291d70d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9d19c8-6b30-462c-8922-41fc25a9b553', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c0af81-fdfa-4f89-9840-951312840c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:07:47 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Volume volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 (bc9d19c8-6b30-462c-8922-41fc25a9b553): created successfully Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c0af81-fdfa-4f89-9840-951312840c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:07:47 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Flow 'volume_create_manager' (bf5a90b7-19bf-4bd1-bd33-c1e7d29a64f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:07:47 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-b87b2060-b102-4b5b-8ba2-059f48f03a40 tempest-ProjectReaderTests-938086930 None] Created volume successfully. Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Creating offline snapshot be471ee6-3002-4877-ab0b-f527a376ccf2 of volume bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f2c7d-498d-4353-8c0a-10360dbc1eb2]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:49 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 Sep 25 14:07:49 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:49 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553" returned: 0 in 0.386s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 1G {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:49 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 1G Sep 25 14:07:49 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:49 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 1G" returned: 0 in 0.409s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:49 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:49 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 Sep 25 14:07:49 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:50 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 -F qcow2 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2" returned: 0 in 0.327s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 is being set with open permissions: ugo+rw Sep 25 14:07:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:50 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 Sep 25 14:07:50 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:50 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2" returned: 0 in 0.267s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:50 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info Sep 25 14:07:50 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:50 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info" returned: 0 in 0.273s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:50 devstack cinder-volume[87220]: WARNING cinder.volume.drivers.remotefs [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info is being set with open permissions: ugo+rw Sep 25 14:07:50 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:50 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info Sep 25 14:07:50 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:51 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.info" returned: 0 in 0.263s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:51 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:51 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-61ff4d58-3789-4f54-97fd-d4b5a9736cf3 tempest-ProjectReaderTests-938086930 None] Create snapshot completed successfully Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-be471ee6-3002-4877-ab0b-f527a376ccf2-delete_snapshot" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Lock "cinder-be471ee6-3002-4877-ab0b-f527a376ccf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-bc9d19c8-6b30-462c-8922-41fc25a9b553" by "delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-bc9d19c8-6b30-462c-8922-41fc25a9b553" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-be471ee6-3002-4877-ab0b-f527a376ccf2" by "_delete_snapshot" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-be471ee6-3002-4877-ab0b-f527a376ccf2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Deleting offline snapshot be471ee6-3002-4877-ab0b-f527a376ccf2 of volume bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] snapshot_file for this snap is: volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 {{(pid=87220) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[c705781d-90e1-4e89-bd44-534a0536bbae]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:52 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 Sep 25 14:07:52 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:52 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2" returned: 0 in 0.436s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc9d19c8-6b30-462c-8922-41fc25a9b553(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87220) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c4b4ee-dfc4-4b27-b824-a3ae9efbd5a0]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:52 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:53 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 Sep 25 14:07:53 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:53 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553" returned: 0 in 0.397s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:53 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 Sep 25 14:07:53 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:53 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2" returned: 0 in 0.380s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:53 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2 Sep 25 14:07:53 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:53 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553.be471ee6-3002-4877-ab0b-f527a376ccf2" returned: 0 in 0.263s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-be471ee6-3002-4877-ab0b-f527a376ccf2" released by "_delete_snapshot" :: held 1.578s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:53 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-bc9d19c8-6b30-462c-8922-41fc25a9b553" released by "delete_snapshot" :: held 1.606s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Created reservations ['7af7c700-9e15-425f-a225-eb5048421898', 'e2bbe371-a93b-4104-a7bb-1699a8d679c0', '149af41c-2024-454f-9e30-8d028fc23fe0', '7a2b7ee1-c6d1-4b74-a3ce-9657f6d84242'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:54 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Delete snapshot completed successfully. Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-240cf239-dee3-4d5f-863b-f3171f1d09e4 tempest-ProjectReaderTests-938086930 None] Lock "cinder-be471ee6-3002-4877-ab0b-f527a376ccf2-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-bc9d19c8-6b30-462c-8922-41fc25a9b553-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Lock "cinder-bc9d19c8-6b30-462c-8922-41fc25a9b553-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Acquiring lock "cinder-quobyte-bc9d19c8-6b30-462c-8922-41fc25a9b553" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-bc9d19c8-6b30-462c-8922-41fc25a9b553" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6f69a-709d-4a2e-b867-d6a583b43fd4]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:07:54 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:54 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 Sep 25 14:07:54 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:55 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553" returned: 0 in 0.418s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:55 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553 Sep 25 14:07:55 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:55 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-bc9d19c8-6b30-462c-8922-41fc25a9b553" returned: 0 in 0.267s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Lock "cinder-quobyte-bc9d19c8-6b30-462c-8922-41fc25a9b553" released by "delete_volume" :: held 0.758s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Created reservations ['6ed7dcb1-90ca-43e3-88ca-21fdc06cdb21', 'e0666ccb-0914-43d4-b918-40d3a3ba6597', 'f1b4c05c-d5e4-4834-9e27-b5d9475b5ce2', 'e890e7b4-cda3-4cfb-bc3e-6e54e628103e'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:07:55 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:07:55 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:07:55 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.315s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:07:55 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Deleted volume successfully. Sep 25 14:07:55 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-4a64e63c-4084-4a18-a6bf-e4dff2184f59 tempest-ProjectReaderTests-938086930 None] Lock "cinder-bc9d19c8-6b30-462c-8922-41fc25a9b553-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:08:05 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:INSERT=15,cinder:UPDATE=53,cinder:SELECT=37,cinder:DELETE=4 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:08:05 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=36,cinder:INSERT=13,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:09 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:10 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:08:10 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:10 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:10 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.260s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:10 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:08:10 devstack cinder-volume[87220]: DEBUG oslo_service.periodic_task [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] Running periodic task VolumeManager._thread_info {{(pid=87220) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 14:08:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread count: 28 {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 14:08:10 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-cb246949-a5ba-4edf-b8a4-970aaa0c6424 None None] thread info: [<_MainThread(MainThread, started 127242152423552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87220) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Flow 'volume_create_manager' (80c4a8fa-ed48-4929-a3f5-52fb7eddc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5a195b-9bea-452f-9b1a-36c47b075c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5a195b-9bea-452f-9b1a-36c47b075c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980647208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0670ce-7228-433c-bfb1-4d9f9353c775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdf7686e19346cd91718a3ebdff4cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:08:15Z,use_quota=True,user_id='236d07e86c924301af01699bc5b0cc5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8801a7-db25-4add-bbfd-ed0d6f7bcdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8801a7-db25-4add-bbfd-ed0d6f7bcdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4117b82-06ab-4a15-b2fd-d9ef168b5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4117b82-06ab-4a15-b2fd-d9ef168b5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0670ce-7228-433c-bfb1-4d9f9353c775', 'volume_name': 'volume-5a0670ce-7228-433c-bfb1-4d9f9353c775', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4660fc63-5ae3-4b7d-9e6d-bcc7beef5540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4660fc63-5ae3-4b7d-9e6d-bcc7beef5540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d321d2c5-b3ef-45f0-8c5a-c93b91c0ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:14 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Volume 5a0670ce-7228-433c-bfb1-4d9f9353c775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0670ce-7228-433c-bfb1-4d9f9353c775', 'volume_size': 1} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980647208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0670ce-7228-433c-bfb1-4d9f9353c775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdf7686e19346cd91718a3ebdff4cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:08:15Z,use_quota=True,user_id='236d07e86c924301af01699bc5b0cc5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Creating volume 5a0670ce-7228-433c-bfb1-4d9f9353c775 {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:08:14 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:08:14 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:14 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 1073741824 Sep 25 14:08:14 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:15 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 1073741824" returned: 0 in 0.415s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:15 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 Sep 25 14:08:15 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:15 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775" returned: 0 in 0.243s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d321d2c5-b3ef-45f0-8c5a-c93b91c0ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0670ce-7228-433c-bfb1-4d9f9353c775', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62da436-69a9-4531-8d43-0b4281f5ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:15 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Volume volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 (5a0670ce-7228-433c-bfb1-4d9f9353c775): created successfully Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62da436-69a9-4531-8d43-0b4281f5ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Flow 'volume_create_manager' (80c4a8fa-ed48-4929-a3f5-52fb7eddc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:08:15 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-e194dde3-65f5-4031-b2ad-a0d89be14d8e tempest-ProjectReaderTests-651551937 None] Created volume successfully. Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Acquiring lock "cinder-5a0670ce-7228-433c-bfb1-4d9f9353c775-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Lock "cinder-5a0670ce-7228-433c-bfb1-4d9f9353c775-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Acquiring lock "cinder-quobyte-5a0670ce-7228-433c-bfb1-4d9f9353c775" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Lock "cinder-quobyte-5a0670ce-7228-433c-bfb1-4d9f9353c775" acquired by "delete_volume" :: waited 0.019s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a64d1f-594e-4f13-b341-82f60d83a6db]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:08:15 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:16 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 Sep 25 14:08:16 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:16 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775" returned: 0 in 0.379s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:16 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775 Sep 25 14:08:16 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:16 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-5a0670ce-7228-433c-bfb1-4d9f9353c775" returned: 0 in 0.267s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Lock "cinder-quobyte-5a0670ce-7228-433c-bfb1-4d9f9353c775" released by "delete_volume" :: held 0.688s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Created reservations ['907cdb59-3347-4e5f-bebb-bfbf8d02a3d5', 'fc4f5b9d-bf64-4dc9-be8f-a83149816ee9', '5701e7f6-ad7f-4004-aa7e-cd79fd2cfc85', '9c864b30-59ab-4f9f-9567-1de16143b4c9'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:16 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:08:16 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:16 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.272s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:16 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:08:16 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Deleted volume successfully. Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-5669414e-690d-45c2-a000-addac1d2963c tempest-ProjectReaderTests-651551937 None] Lock "cinder-5a0670ce-7228-433c-bfb1-4d9f9353c775-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.flows.manager.create_volume [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87220) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Flow 'volume_create_manager' (1c2e9f83-0857-4ad5-a953-bac87e617639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207b1a35-a3e8-4c24-a67c-ea813fe1364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207b1a35-a3e8-4c24-a67c-ea813fe1364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758470517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1380cb91-3c85-4dd1-a276-bf25bbb0fb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdf7686e19346cd91718a3ebdff4cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:08:17Z,use_quota=True,user_id='236d07e86c924301af01699bc5b0cc5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9608fad2-274e-41c7-8c33-acd3d4925c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9608fad2-274e-41c7-8c33-acd3d4925c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd1a6b0-1825-4d73-b136-dfa4a89e394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd1a6b0-1825-4d73-b136-dfa4a89e394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1380cb91-3c85-4dd1-a276-bf25bbb0fb3d', 'volume_name': 'volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1503f8c9-375e-4e0f-8023-48d48d73ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1503f8c9-375e-4e0f-8023-48d48d73ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de0aa1-3b83-40a8-ad54-cf04c85b367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:17 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Volume 1380cb91-3c85-4dd1-a276-bf25bbb0fb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d', 'volume_size': 1} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T12:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758470517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1380cb91-3c85-4dd1-a276-bf25bbb0fb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdf7686e19346cd91718a3ebdff4cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:08:17Z,use_quota=True,user_id='236d07e86c924301af01699bc5b0cc5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e3fb28c-2cab-4555-a54a-6a0328ae5750),volume_type_id=6e3fb28c-2cab-4555-a54a-6a0328ae5750)}" {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.remotefs [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Creating volume 1380cb91-3c85-4dd1-a276-bf25bbb0fb3d {{(pid=87220) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Selected osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 as target Quobyte volume. {{(pid=87220) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 14:08:17 devstack cinder-volume[87220]: INFO cinder.volume.drivers.remotefs [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] casted to osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60 Sep 25 14:08:17 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d 1073741824 {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:17 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d 1073741824 Sep 25 14:08:17 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:18 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d 1073741824" returned: 0 in 0.463s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:18 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d Sep 25 14:08:18 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:18 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d" returned: 0 in 0.264s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'} {{(pid=87220) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de0aa1-3b83-40a8-ad54-cf04c85b367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d', 'volume_size': 1}' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f84fb7d-99da-4e1a-9f53-3ad9320734a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 14:08:18 devstack cinder-volume[87220]: INFO cinder.volume.flows.manager.create_volume [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Volume volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d (1380cb91-3c85-4dd1-a276-bf25bbb0fb3d): created successfully Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f84fb7d-99da-4e1a-9f53-3ad9320734a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87220) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Flow 'volume_create_manager' (1c2e9f83-0857-4ad5-a953-bac87e617639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87220) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 14:08:18 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-66da0480-c73f-4810-83c4-835b19bca4d8 tempest-ProjectReaderTests-651551937 None] Created volume successfully. Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Acquiring lock "cinder-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d-delete_volume" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Lock "cinder-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Acquiring lock "cinder-quobyte-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d" by "delete_volume" {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Lock "cinder-quobyte-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d" acquired by "delete_volume" :: waited 0.016s {{(pid=87220) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a87e602-e709-436d-b68a-9785eb3a2149]: (4, 'qcow2') {{(pid=89016) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 14:08:18 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:18 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d Sep 25 14:08:18 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:19 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d" returned: 0 in 0.399s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:19 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d Sep 25 14:08:19 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:19 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d/volume-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d" returned: 0 in 0.288s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Lock "cinder-quobyte-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d" released by "delete_volume" :: held 0.729s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG cinder.quota [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Created reservations ['994255aa-1ccb-4528-a8f8-edd474390325', '65d12aee-560d-4f98-bf3b-1d95cc11d28f', '01ee20c8-7985-4063-b903-47a5794cd817', 'a2c85213-620d-4cae-8d94-76eacc342848'] {{(pid=87220) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60': None} {{(pid=87220) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG cinder.volume.drivers.quobyte [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e2d9d37-4a3a-4112-a2ed-bc635cf80c60'] {{(pid=87220) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87220) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 14:08:19 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d Sep 25 14:08:19 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 14:08:19 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG oslo_concurrency.processutils [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0ec267b62af99f573b9048fbd4369d" returned: 0 in 0.263s {{(pid=87220) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG cinder.manager [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Notifying Schedulers of capabilities ... {{(pid=87220) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 14:08:19 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Deleted volume successfully. Sep 25 14:08:19 devstack cinder-volume[87220]: DEBUG cinder.coordination [None req-25388692-3ebd-424c-afa7-debcbc5fbd01 tempest-ProjectReaderTests-651551937 None] Lock "cinder-1380cb91-3c85-4dd1-a276-bf25bbb0fb3d-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87220) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 14:08:29 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 14:08:29 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:UPDATE=24,cinder:SELECT=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}